Aug 16 06:05:24 user nova-compute[74681]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 06:05:27 user nova-compute[74681]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74681) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 06:05:27 user nova-compute[74681]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74681) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 06:05:27 user nova-compute[74681]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74681) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 06:05:27 user nova-compute[74681]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:05:28 user nova-compute[74681]: INFO nova.virt.driver [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 06:05:28 user nova-compute[74681]: INFO nova.compute.provider_config [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] Acquiring lock "singleton_lock" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] Acquired lock "singleton_lock" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] Releasing lock "singleton_lock" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] Full set of CONF: {{(pid=74681) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ******************************************************************************** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] Configuration options gathered from: {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ================================================================================ {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] allow_resize_to_same_host      = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] arq_binding_timeout            = 300 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] backdoor_port                  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] backdoor_socket                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] block_device_allocate_retries  = 300 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] block_device_allocate_retries_interval = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cert                           = self.pem {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute_monitors               = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] config_dir                     = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] config_drive_format            = iso9660 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] config_source                  = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] console_host                   = user {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] control_exchange               = nova {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cpu_allocation_ratio           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] daemon                         = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] debug                          = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] default_access_ip_network_name = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] default_availability_zone      = nova {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] default_ephemeral_format       = ext4 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] default_schedule_zone          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] disk_allocation_ratio          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] enable_new_services            = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] enabled_ssl_apis               = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] flat_injected                  = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] force_config_drive             = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] force_raw_images               = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] graceful_shutdown_timeout      = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] heal_instance_info_cache_interval = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] host                           = user {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] instance_build_timeout         = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] instance_delete_interval       = 300 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] instance_name_template         = instance-%08x {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] instance_usage_audit           = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] instance_usage_audit_period    = month {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] internal_service_availability_zone = internal {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] key                            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] live_migration_retry_count     = 30 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] log_config_append              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] log_dir                        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] log_file                       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] log_options                    = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] log_rotate_interval            = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] log_rotate_interval_type       = days {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] log_rotation_type              = none {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] long_rpc_timeout               = 1800 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] max_concurrent_builds          = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] max_concurrent_live_migrations = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] max_concurrent_snapshots       = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] max_local_block_devices        = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] max_logfile_count              = 30 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] max_logfile_size_mb            = 200 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] maximum_instance_delete_attempts = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] metadata_listen                = 0.0.0.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] metadata_listen_port           = 8775 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] metadata_workers               = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] migrate_max_retries            = -1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] mkisofs_cmd                    = genisoimage {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] my_ip                          = 10.0.0.210 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] network_allocate_retries       = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] osapi_compute_listen_port      = 8774 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] osapi_compute_unique_server_name_scope =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] osapi_compute_workers          = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] password_length                = 12 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] periodic_enable                = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] periodic_fuzzy_delay           = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] pointer_model                  = ps2mouse {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] preallocate_images             = none {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] publish_errors                 = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] pybasedir                      = /opt/stack/nova {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ram_allocation_ratio           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] rate_limit_burst               = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] rate_limit_except_level        = CRITICAL {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] rate_limit_interval            = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] reboot_timeout                 = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] reclaim_instance_interval      = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] record                         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] reimage_timeout_per_gb         = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] report_interval                = 120 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] rescue_timeout                 = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] reserved_host_cpus             = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] reserved_host_disk_mb          = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] reserved_host_memory_mb        = 512 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] reserved_huge_pages            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] resize_confirm_window          = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] resize_fs_using_block_device   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] resume_guests_state_on_host_boot = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] rpc_response_timeout           = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] run_external_periodic_tasks    = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] running_deleted_instance_action = reap {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] running_deleted_instance_timeout = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler_instance_sync_interval = 120 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_down_time              = 720 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] servicegroup_driver            = db {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] shelved_offload_time           = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] shelved_poll_interval          = 3600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] shutdown_timeout               = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] source_is_ipv6                 = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ssl_only                       = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] state_path                     = /opt/stack/data/nova {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] sync_power_state_interval      = 600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] sync_power_state_pool_size     = 1000 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] syslog_log_facility            = LOG_USER {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] tempdir                        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] timeout_nbd                    = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] transport_url                  = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] update_resources_interval      = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] use_cow_images                 = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] use_eventlog                   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] use_journal                    = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] use_json                       = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] use_rootwrap_daemon            = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] use_stderr                     = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] use_syslog                     = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vcpu_pin_set                   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plugging_is_fatal          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plugging_timeout           = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] virt_mkfs                      = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] volume_usage_poll_interval     = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] watch_log_file                 = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] web                            = /usr/share/spice-html5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_concurrency.disable_process_locking = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.auth_strategy              = keystone {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.compute_link_prefix        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.dhcp_domain                = novalocal {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.enable_instance_password   = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.glance_link_prefix         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.instance_list_per_project_cells = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.list_records_by_skipping_down_cells = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.local_metadata_per_cell    = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.max_limit                  = 1000 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.metadata_cache_expiration  = 15 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.neutron_default_tenant_id  = default {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.use_forwarded_for          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.use_neutron_default_nets   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.vendordata_dynamic_targets = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.vendordata_jsonfile_path   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.backend_argument         = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.config_prefix            = cache.oslo {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.dead_timeout             = 60.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.debug_cache_backend      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.enable_retry_client      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.enable_socket_keepalive  = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.enabled                  = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.expiration_time          = 600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.hashclient_retry_attempts = 2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_dead_retry      = 300 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_password        =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_sasl_enabled    = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.memcache_username        =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.proxies                  = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.retry_attempts           = 2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.retry_delay              = 0.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.socket_keepalive_count   = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.socket_keepalive_idle    = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.socket_keepalive_interval = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.tls_allowed_ciphers      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.tls_cafile               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.tls_certfile             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.tls_enabled              = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cache.tls_keyfile              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.auth_section            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.auth_type               = password {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.cafile                  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.certfile                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.collect_timing          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.cross_az_attach         = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.debug                   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.endpoint_template       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.http_retries            = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.insecure                = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.keyfile                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.os_region_name          = RegionOne {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.split_loggers           = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cinder.timeout                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.cpu_dedicated_set      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.cpu_shared_set         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.image_type_exclude_list = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.resource_provider_association_refresh = 300 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.shutdown_retry_interval = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] conductor.workers              = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] console.allowed_origins        = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] console.ssl_ciphers            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] console.ssl_minimum_version    = default {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] consoleauth.token_ttl          = 600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.cafile                  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.certfile                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.collect_timing          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.connect_retries         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.connect_retry_delay     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.endpoint_override       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.insecure                = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.keyfile                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.max_version             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.min_version             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.region_name             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.service_name            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.service_type            = accelerator {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.split_loggers           = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.status_code_retries     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.status_code_retry_delay = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.timeout                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] cyborg.version                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.backend               = sqlalchemy {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.connection            = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.connection_debug      = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.connection_parameters =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.connection_recycle_time = 3600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.connection_trace      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.db_inc_retry_interval = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.db_max_retries        = 20 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.db_max_retry_interval = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.db_retry_interval     = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.max_overflow          = 50 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.max_pool_size         = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.max_retries           = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.mysql_enable_ndb      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.mysql_wsrep_sync_wait = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.pool_timeout          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.retry_interval        = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.slave_connection      = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] database.sqlite_synchronous    = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.backend           = sqlalchemy {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.connection        = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.connection_debug  = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.connection_parameters =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.connection_recycle_time = 3600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.connection_trace  = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.db_inc_retry_interval = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.db_max_retries    = 20 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.db_max_retry_interval = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.db_retry_interval = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.max_overflow      = 50 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.max_pool_size     = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.max_retries       = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.mysql_enable_ndb  = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.pool_timeout      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.retry_interval    = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.slave_connection  = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] api_database.sqlite_synchronous = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] devices.enabled_mdev_types     = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ephemeral_storage_encryption.enabled = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.api_servers             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.cafile                  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.certfile                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.collect_timing          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.connect_retries         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.connect_retry_delay     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.debug                   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.default_trusted_certificate_ids = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.enable_certificate_validation = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.enable_rbd_download     = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.endpoint_override       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.insecure                = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.keyfile                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.max_version             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.min_version             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.num_retries             = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.rbd_ceph_conf           =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.rbd_connect_timeout     = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.rbd_pool                =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.rbd_user                =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.region_name             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.service_name            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.service_type            = image {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.split_loggers           = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.status_code_retries     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.status_code_retry_delay = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.timeout                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.verify_glance_signatures = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] glance.version                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] guestfs.debug                  = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.config_drive_cdrom      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.config_drive_inject_password = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.enable_remotefx         = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.instances_path_share    =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.limit_cpu_features      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.use_multipath_io        = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.vswitch_name            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] mks.enabled                    = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] image_cache.manager_interval   = 2400 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] image_cache.precache_concurrency = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] image_cache.remove_unused_base_images = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] image_cache.subdirectory_name  = _base {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.api_max_retries         = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.api_retry_interval      = 2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.auth_section            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.auth_type               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.cafile                  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.certfile                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.collect_timing          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.connect_retries         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.connect_retry_delay     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.endpoint_override       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.insecure                = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.keyfile                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.max_version             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.min_version             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.partition_key           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.peer_list               = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.region_name             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.serial_console_state_timeout = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.service_name            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.service_type            = baremetal {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.split_loggers           = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.status_code_retries     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.status_code_retry_delay = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.timeout                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ironic.version                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] key_manager.fixed_key          = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.barbican_api_version  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.barbican_endpoint     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.barbican_endpoint_type = public {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.barbican_region_name  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.cafile                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.certfile              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.collect_timing        = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.insecure              = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.keyfile               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.number_of_retries     = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.retry_delay           = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.send_service_user_token = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.split_loggers         = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.timeout               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.verify_ssl            = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican.verify_ssl_path       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.auth_section = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.auth_type = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.cafile   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.certfile = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.collect_timing = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.insecure = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.keyfile  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.split_loggers = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] barbican_service_user.timeout  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.approle_role_id          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.approle_secret_id        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.cafile                   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.certfile                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.collect_timing           = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.insecure                 = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.keyfile                  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.kv_mountpoint            = secret {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.kv_version               = 2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.namespace                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.root_token_id            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.split_loggers            = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.ssl_ca_crt_file          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.timeout                  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.use_ssl                  = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.cafile                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.certfile              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.collect_timing        = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.connect_retries       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.connect_retry_delay   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.endpoint_override     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.insecure              = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.keyfile               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.max_version           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.min_version           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.region_name           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.service_name          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.service_type          = identity {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.split_loggers         = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.status_code_retries   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.status_code_retry_delay = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.timeout               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] keystone.version               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.connection_uri         =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.cpu_mode               = custom {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: WARNING oslo_config.cfg [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.cpu_power_governor_high = performance {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.cpu_power_management   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.device_detach_attempts = 8 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.device_detach_timeout  = 20 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.disk_cachemodes        = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.disk_prefix            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.enabled_perf_events    = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.file_backed_memory     = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.gid_maps               = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.hw_disk_discard        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.hw_machine_type        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.images_rbd_pool        = rbd {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.images_type            = default {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.images_volume_group    = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.inject_key             = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.inject_partition       = -2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.inject_password        = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.iscsi_iface            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.iser_use_multipath     = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_downtime = 500 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_inbound_addr = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_scheme  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_timeout_action = abort {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_tunnelled = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: WARNING oslo_config.cfg [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 06:05:28 user nova-compute[74681]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 06:05:28 user nova-compute[74681]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 06:05:28 user nova-compute[74681]: and ``live_migration_inbound_addr`` respectively.
Aug 16 06:05:28 user nova-compute[74681]: ).  Its value may be silently ignored in the future.
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.live_migration_with_native_tls = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.max_queues             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.nfs_mount_options      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.num_pcie_ports         = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.pmem_namespaces        = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.quobyte_client_cfg     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rbd_secret_uuid        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rbd_user               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rescue_image_id        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rescue_kernel_id       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.rx_queue_size          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.smbfs_mount_options    =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.snapshot_compression   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.snapshot_image_format  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.sparse_logical_volumes = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.swtpm_enabled          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.swtpm_group            = tss {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.swtpm_user             = tss {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.sysinfo_serial         = unique {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.tb_cache_size          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.tx_queue_size          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.uid_maps               = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.use_virtio_for_bridges = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.virt_type              = kvm {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.volume_clear           = zero {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.volume_clear_size      = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.volume_use_multipath   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.vzstorage_cache_path   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.auth_section           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.auth_type              = password {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.cafile                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.certfile               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.collect_timing         = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.connect_retries        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.connect_retry_delay    = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.default_floating_pool  = public {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.endpoint_override      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.extension_sync_interval = 600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.http_retries           = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.insecure               = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.keyfile                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.max_version            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.min_version            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.ovs_bridge             = br-int {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.physnets               = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.region_name            = RegionOne {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.service_metadata_proxy = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.service_name           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.service_type           = network {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.split_loggers          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.status_code_retries    = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.status_code_retry_delay = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.timeout                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] neutron.version                = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] notifications.bdms_in_notifications = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] notifications.default_level    = INFO {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] notifications.notification_format = unversioned {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] notifications.notify_on_state_change = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] pci.alias                      = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] pci.device_spec                = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] pci.report_in_placement        = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.auth_section         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.auth_type            = password {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.cafile               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.certfile             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.collect_timing       = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.connect_retries      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.connect_retry_delay  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.default_domain_id    = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.default_domain_name  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.domain_id            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.domain_name          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.endpoint_override    = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.insecure             = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.keyfile              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.max_version          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.min_version          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.password             = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.project_domain_id    = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.project_domain_name  = Default {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.project_id           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.project_name         = service {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.region_name          = RegionOne {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.service_name         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.service_type         = placement {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.split_loggers        = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.status_code_retries  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.status_code_retry_delay = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.system_scope         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.timeout              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.trust_id             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.user_domain_id       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.user_domain_name     = Default {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.user_id              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.username             = placement {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] placement.version              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.cores                    = 20 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.count_usage_from_placement = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.injected_file_content_bytes = 10240 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.injected_file_path_length = 255 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.injected_files           = 5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.instances                = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.key_pairs                = 100 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.metadata_items           = 128 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.ram                      = 51200 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.recheck_quota            = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.server_group_members     = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] quota.server_groups            = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] rdp.enabled                    = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.image_metadata_prefilter = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.max_attempts         = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.max_placement_results = 1000 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.query_placement_for_availability_zone = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] scheduler.workers              = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.host_subset_size = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.isolated_hosts = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.isolated_images = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.pci_in_placement = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.track_instance_changes = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] metrics.required               = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] metrics.weight_multiplier      = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] metrics.weight_setting         = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] serial_console.enabled         = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] serial_console.port_range      = 10000:20000 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] serial_console.serialproxy_port = 6083 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.auth_section      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.auth_type         = password {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.cafile            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.certfile          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.collect_timing    = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.insecure          = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.keyfile           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.send_service_user_token = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.split_loggers     = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] service_user.timeout           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.agent_enabled            = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.enabled                  = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.html5proxy_port          = 6082 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.image_compression        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.jpeg_compression         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.playback_compression     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.server_listen            = 127.0.0.1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.streaming_mode           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] spice.zlib_compression         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] upgrade_levels.baseapi         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] upgrade_levels.cert            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] upgrade_levels.compute         = auto {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] upgrade_levels.conductor       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] upgrade_levels.scheduler       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.cafile = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.certfile = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.insecure = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vendordata_dynamic_auth.timeout = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.api_retry_count         = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.ca_file                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.cache_prefix            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.cluster_name            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.connection_pool_size    = 10 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.console_delay_seconds   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.datastore_regex         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.host_ip                 = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.host_password           = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.host_port               = 443 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.host_username           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.insecure                = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.integration_bridge      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.maximum_objects         = 100 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.pbm_default_policy      = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.pbm_enabled             = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.pbm_wsdl_location       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.serial_port_proxy_uri   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.serial_port_service_uri = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.task_poll_interval      = 0.5 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.use_linked_clone        = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.vnc_keymap              = en-us {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.vnc_port                = 5900 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vmware.vnc_port_total          = 10000 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.auth_schemes               = ['none'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.enabled                    = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.novncproxy_port            = 6080 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.vencrypt_ca_certs          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.vencrypt_client_cert       = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vnc.vencrypt_client_key        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.disable_rootwrap   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.enable_numa_live_migration = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.libvirt_disable_apic = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.client_socket_timeout     = 900 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.default_pool_size         = 1000 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.keep_alive                = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.max_header_line           = 16384 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.ssl_ca_file               = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.ssl_cert_file             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.ssl_key_file              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.tcp_keepidle              = 600 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] zvm.ca_file                    = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] zvm.cloud_connector_url        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] zvm.reachable_timeout          = 300 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.enforce_new_defaults = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.enforce_scope      = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.policy_default_rule = default {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.connection_string     = messaging:// {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.enabled               = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.es_doc_type           = notification {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.es_scroll_size        = 10000 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.es_scroll_time        = 2m {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.filter_error_trace    = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.hmac_keys             = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.sentinel_service_name = mymaster {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.socket_timeout        = 0.1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.trace_requests        = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler.trace_sqlalchemy      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler_jaeger.process_tags   = {} {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler_jaeger.service_name_prefix = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] profiler_otlp.service_name_prefix = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] remote_debug.host              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] remote_debug.port              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_notifications.retry = -1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.auth_section        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.auth_type           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.cafile              = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.certfile            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.collect_timing      = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.connect_retries     = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.connect_retry_delay = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.endpoint_id         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.endpoint_override   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.insecure            = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.keyfile             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.max_version         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.min_version         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.region_name         = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.service_name        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.service_type        = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.split_loggers       = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.status_code_retries = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.status_code_retry_delay = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.timeout             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.valid_interfaces    = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_limit.version             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_reports.file_event_handler = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] oslo_reports.log_dir           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_ovs_privileged.group  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] vif_plug_ovs_privileged.user   = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_ovs.isolate_vif         = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] os_brick.lock_path             = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] privsep_osbrick.capabilities   = [21] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] privsep_osbrick.group          = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] privsep_osbrick.helper_command = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] privsep_osbrick.user           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] nova_sys_admin.group           = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] nova_sys_admin.helper_command  = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] nova_sys_admin.user            = None {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG oslo_service.service [None req-6e900560-6e57-4929-82e2-9db1ba29f513 None None] ******************************************************************************** {{(pid=74681) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 06:05:28 user nova-compute[74681]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 06:05:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Starting native event thread {{(pid=74681) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Starting green dispatch thread {{(pid=74681) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Starting connection event dispatch thread {{(pid=74681) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Connecting to libvirt: qemu:///system {{(pid=74681) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f949c6a0f40> {{(pid=74681) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 06:05:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f949c6a0f40> {{(pid=74681) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 06:05:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Connection event '1' reason 'None'
Aug 16 06:05:28 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 06:05:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.mount [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Initialising _HostMountState generation 0 {{(pid=74681) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 06:05:37 user nova-compute[74681]: INFO nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host capabilities <capabilities>
Aug 16 06:05:37 user nova-compute[74681]:   <host>
Aug 16 06:05:37 user nova-compute[74681]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 06:05:37 user nova-compute[74681]:     <cpu>
Aug 16 06:05:37 user nova-compute[74681]:       <arch>x86_64</arch>
Aug 16 06:05:37 user nova-compute[74681]:       <model>IvyBridge-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:37 user nova-compute[74681]:       <microcode version='1070'/>
Aug 16 06:05:37 user nova-compute[74681]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 06:05:37 user nova-compute[74681]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='ss'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='vmx'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='pcid'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='osxsave'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='hypervisor'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='arat'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='tsc_adjust'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='md-clear'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='stibp'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='arch-capabilities'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='ssbd'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='invtsc'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='rsba'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 06:05:37 user nova-compute[74681]:       <pages unit='KiB' size='4'/>
Aug 16 06:05:37 user nova-compute[74681]:       <pages unit='KiB' size='2048'/>
Aug 16 06:05:37 user nova-compute[74681]:     </cpu>
Aug 16 06:05:37 user nova-compute[74681]:     <power_management>
Aug 16 06:05:37 user nova-compute[74681]:       <suspend_mem/>
Aug 16 06:05:37 user nova-compute[74681]:       <suspend_disk/>
Aug 16 06:05:37 user nova-compute[74681]:       <suspend_hybrid/>
Aug 16 06:05:37 user nova-compute[74681]:     </power_management>
Aug 16 06:05:37 user nova-compute[74681]:     <iommu support='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     <migration_features>
Aug 16 06:05:37 user nova-compute[74681]:       <live/>
Aug 16 06:05:37 user nova-compute[74681]:       <uri_transports>
Aug 16 06:05:37 user nova-compute[74681]:         <uri_transport>tcp</uri_transport>
Aug 16 06:05:37 user nova-compute[74681]:         <uri_transport>rdma</uri_transport>
Aug 16 06:05:37 user nova-compute[74681]:       </uri_transports>
Aug 16 06:05:37 user nova-compute[74681]:     </migration_features>
Aug 16 06:05:37 user nova-compute[74681]:     <topology>
Aug 16 06:05:37 user nova-compute[74681]:       <cells num='2'>
Aug 16 06:05:37 user nova-compute[74681]:         <cell id='0'>
Aug 16 06:05:37 user nova-compute[74681]:           <memory unit='KiB'>8189224</memory>
Aug 16 06:05:37 user nova-compute[74681]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 16 06:05:37 user nova-compute[74681]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 06:05:37 user nova-compute[74681]:           <distances>
Aug 16 06:05:37 user nova-compute[74681]:             <sibling id='0' value='10'/>
Aug 16 06:05:37 user nova-compute[74681]:             <sibling id='1' value='20'/>
Aug 16 06:05:37 user nova-compute[74681]:           </distances>
Aug 16 06:05:37 user nova-compute[74681]:           <cpus num='6'>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 06:05:37 user nova-compute[74681]:           </cpus>
Aug 16 06:05:37 user nova-compute[74681]:         </cell>
Aug 16 06:05:37 user nova-compute[74681]:         <cell id='1'>
Aug 16 06:05:37 user nova-compute[74681]:           <memory unit='KiB'>8206460</memory>
Aug 16 06:05:37 user nova-compute[74681]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 16 06:05:37 user nova-compute[74681]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 06:05:37 user nova-compute[74681]:           <distances>
Aug 16 06:05:37 user nova-compute[74681]:             <sibling id='0' value='20'/>
Aug 16 06:05:37 user nova-compute[74681]:             <sibling id='1' value='10'/>
Aug 16 06:05:37 user nova-compute[74681]:           </distances>
Aug 16 06:05:37 user nova-compute[74681]:           <cpus num='6'>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 06:05:37 user nova-compute[74681]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 06:05:37 user nova-compute[74681]:           </cpus>
Aug 16 06:05:37 user nova-compute[74681]:         </cell>
Aug 16 06:05:37 user nova-compute[74681]:       </cells>
Aug 16 06:05:37 user nova-compute[74681]:     </topology>
Aug 16 06:05:37 user nova-compute[74681]:     <cache>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 06:05:37 user nova-compute[74681]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 06:05:37 user nova-compute[74681]:     </cache>
Aug 16 06:05:37 user nova-compute[74681]:     <secmodel>
Aug 16 06:05:37 user nova-compute[74681]:       <model>apparmor</model>
Aug 16 06:05:37 user nova-compute[74681]:       <doi>0</doi>
Aug 16 06:05:37 user nova-compute[74681]:     </secmodel>
Aug 16 06:05:37 user nova-compute[74681]:     <secmodel>
Aug 16 06:05:37 user nova-compute[74681]:       <model>dac</model>
Aug 16 06:05:37 user nova-compute[74681]:       <doi>0</doi>
Aug 16 06:05:37 user nova-compute[74681]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 06:05:37 user nova-compute[74681]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 06:05:37 user nova-compute[74681]:     </secmodel>
Aug 16 06:05:37 user nova-compute[74681]:   </host>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='alpha'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>clipper</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='armv6l'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>spitz</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>nuri</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>kzm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sx1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>z2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>tosa</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>n810</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>n800</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>terrier</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>midway</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>microbit</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>verdex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>highbank</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>akita</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>connex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>collie</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='armv7l'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>spitz</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>nuri</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>kzm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sx1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>z2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>tosa</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>n810</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>n800</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>terrier</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>midway</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>microbit</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>verdex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>highbank</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>akita</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>connex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>collie</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='aarch64'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>spitz</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>nuri</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>kzm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sx1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>z2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>tosa</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>n810</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>n800</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>terrier</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>midway</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>microbit</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>verdex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>highbank</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>akita</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>connex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>collie</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <acpi default='on' toggle='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='cris'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='i686'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>isapc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>microvm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='kvm'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <pae/>
Aug 16 06:05:37 user nova-compute[74681]:       <nonpae/>
Aug 16 06:05:37 user nova-compute[74681]:       <acpi default='on' toggle='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:       <apic default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='m68k'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>an5206</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>q800</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='microblaze'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='microblazeel'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='mips'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='16'>malta</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='mipsel'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='16'>malta</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='mips64'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='16'>malta</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>pica61</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>magnum</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='mips64el'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='16'>malta</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>pica61</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>magnum</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='16'>boston</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='ppc'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mac99</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>40p</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>taihu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='ppc64'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>taihu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>40p</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mac99</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='ppc64le'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>taihu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>40p</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>mac99</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='riscv32'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='8'>spike</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='8'>virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='riscv64'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='8'>spike</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='8'>virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='s390x'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='sh4'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>shix</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>r2d</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='sh4eb'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>shix</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>r2d</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='sparc'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>LX</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='sparc64'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>niagara</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='x86_64'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>64</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='1'>isapc</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>microvm</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='kvm'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <acpi default='on' toggle='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:       <apic default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='xtensa'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>sim</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>kc705</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>ml605</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>lx200</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>lx60</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]:   <guest>
Aug 16 06:05:37 user nova-compute[74681]:     <os_type>hvm</os_type>
Aug 16 06:05:37 user nova-compute[74681]:     <arch name='xtensaeb'>
Aug 16 06:05:37 user nova-compute[74681]:       <wordsize>32</wordsize>
Aug 16 06:05:37 user nova-compute[74681]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='4'>sim</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>kc705</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>ml605</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>virt</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>lx200</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>lx60</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 06:05:37 user nova-compute[74681]:       <domain type='qemu'/>
Aug 16 06:05:37 user nova-compute[74681]:     </arch>
Aug 16 06:05:37 user nova-compute[74681]:     <features>
Aug 16 06:05:37 user nova-compute[74681]:       <cpuselection/>
Aug 16 06:05:37 user nova-compute[74681]:       <deviceboot/>
Aug 16 06:05:37 user nova-compute[74681]:       <disksnapshot default='on' toggle='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     </features>
Aug 16 06:05:37 user nova-compute[74681]:   </guest>
Aug 16 06:05:37 user nova-compute[74681]: </capabilities>
Aug 16 06:05:37 user nova-compute[74681]: 
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 06:05:37 user nova-compute[74681]: <domainCapabilities>
Aug 16 06:05:37 user nova-compute[74681]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 06:05:37 user nova-compute[74681]:   <domain>kvm</domain>
Aug 16 06:05:37 user nova-compute[74681]:   <machine>pc-i440fx-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:   <arch>i686</arch>
Aug 16 06:05:37 user nova-compute[74681]:   <vcpu max='255'/>
Aug 16 06:05:37 user nova-compute[74681]:   <iothreads supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:   <os supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:     <enum name='firmware'/>
Aug 16 06:05:37 user nova-compute[74681]:     <loader supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>rom</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>pflash</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='readonly'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='secure'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </loader>
Aug 16 06:05:37 user nova-compute[74681]:   </os>
Aug 16 06:05:37 user nova-compute[74681]:   <cpu>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='host-passthrough' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='hostPassthroughMigratable'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='maximum' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='maximumMigratable'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='host-model' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ss'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='vmx'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='pcid'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='hypervisor'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='arat'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='umip'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='md-clear'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='stibp'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ssbd'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ibpb'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ibrs'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='amd-stibp'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='erms'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='lm'/>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='custom' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>qemu64</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>qemu32</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>phenom</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium3</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium2</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>n270</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>kvm64</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>kvm32</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>coreduo</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>core2duo</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>athlon</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Westmere</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Snowridge</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Server</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Client</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>SandyBridge</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Penryn</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G5</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G4</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G3</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G2</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G1</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Nehalem</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>IvyBridge</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Icelake-Server</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Haswell</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>EPYC-Rome</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>EPYC-Milan</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>EPYC</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Dhyana</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Cooperlake</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Conroe</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Broadwell</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>486</model>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:   </cpu>
Aug 16 06:05:37 user nova-compute[74681]:   <memoryBacking supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:     <enum name='sourceType'>
Aug 16 06:05:37 user nova-compute[74681]:       <value>file</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>anonymous</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>memfd</value>
Aug 16 06:05:37 user nova-compute[74681]:     </enum>
Aug 16 06:05:37 user nova-compute[74681]:   </memoryBacking>
Aug 16 06:05:37 user nova-compute[74681]:   <devices>
Aug 16 06:05:37 user nova-compute[74681]:     <disk supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='diskDevice'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>disk</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>cdrom</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>floppy</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>lun</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='bus'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>ide</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>fdc</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>sata</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </disk>
Aug 16 06:05:37 user nova-compute[74681]:     <graphics supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>sdl</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>vnc</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>spice</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>egl-headless</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </graphics>
Aug 16 06:05:37 user nova-compute[74681]:     <video supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='modelType'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>vga</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>cirrus</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>vmvga</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>qxl</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>none</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>bochs</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>ramfb</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </video>
Aug 16 06:05:37 user nova-compute[74681]:     <hostdev supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='mode'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>subsystem</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='startupPolicy'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>default</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>mandatory</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>requisite</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>optional</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='subsysType'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>pci</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='capsType'/>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='pciBackend'/>
Aug 16 06:05:37 user nova-compute[74681]:     </hostdev>
Aug 16 06:05:37 user nova-compute[74681]:     <rng supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>random</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>egd</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>builtin</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </rng>
Aug 16 06:05:37 user nova-compute[74681]:     <filesystem supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='driverType'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>path</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>handle</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtiofs</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </filesystem>
Aug 16 06:05:37 user nova-compute[74681]:     <tpm supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>tpm-tis</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>tpm-crb</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>passthrough</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>emulator</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </tpm>
Aug 16 06:05:37 user nova-compute[74681]:   </devices>
Aug 16 06:05:37 user nova-compute[74681]:   <features>
Aug 16 06:05:37 user nova-compute[74681]:     <gic supported='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     <vmcoreinfo supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:     <genid supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:     <backingStoreInput supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:     <backup supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:     <sev supported='no'/>
Aug 16 06:05:37 user nova-compute[74681]:   </features>
Aug 16 06:05:37 user nova-compute[74681]: </domainCapabilities>
Aug 16 06:05:37 user nova-compute[74681]:  {{(pid=74681) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 06:05:37 user nova-compute[74681]: <domainCapabilities>
Aug 16 06:05:37 user nova-compute[74681]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 06:05:37 user nova-compute[74681]:   <domain>kvm</domain>
Aug 16 06:05:37 user nova-compute[74681]:   <machine>pc-q35-jammy</machine>
Aug 16 06:05:37 user nova-compute[74681]:   <arch>i686</arch>
Aug 16 06:05:37 user nova-compute[74681]:   <vcpu max='288'/>
Aug 16 06:05:37 user nova-compute[74681]:   <iothreads supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:   <os supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:     <enum name='firmware'/>
Aug 16 06:05:37 user nova-compute[74681]:     <loader supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>rom</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>pflash</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='readonly'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='secure'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </loader>
Aug 16 06:05:37 user nova-compute[74681]:   </os>
Aug 16 06:05:37 user nova-compute[74681]:   <cpu>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='host-passthrough' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='hostPassthroughMigratable'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='maximum' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='maximumMigratable'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='host-model' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ss'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='vmx'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='pcid'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='hypervisor'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='arat'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='umip'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='md-clear'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='stibp'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ssbd'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ibpb'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ibrs'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='amd-stibp'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='erms'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='lm'/>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='custom' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>qemu64</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>qemu32</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>phenom</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium3</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium2</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>n270</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>kvm64</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>kvm32</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>coreduo</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>core2duo</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>athlon</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Westmere</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Snowridge</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Server</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Skylake-Client</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>SandyBridge</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Penryn</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G5</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G4</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G3</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G2</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Opteron_G1</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Nehalem</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>IvyBridge</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Icelake-Server</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Haswell</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>EPYC-Rome</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>EPYC-Milan</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>EPYC</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Dhyana</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Cooperlake</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Conroe</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>Broadwell</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>486</model>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:   </cpu>
Aug 16 06:05:37 user nova-compute[74681]:   <memoryBacking supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:     <enum name='sourceType'>
Aug 16 06:05:37 user nova-compute[74681]:       <value>file</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>anonymous</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>memfd</value>
Aug 16 06:05:37 user nova-compute[74681]:     </enum>
Aug 16 06:05:37 user nova-compute[74681]:   </memoryBacking>
Aug 16 06:05:37 user nova-compute[74681]:   <devices>
Aug 16 06:05:37 user nova-compute[74681]:     <disk supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='diskDevice'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>disk</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>cdrom</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>floppy</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>lun</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='bus'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>fdc</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>sata</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </disk>
Aug 16 06:05:37 user nova-compute[74681]:     <graphics supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>sdl</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>vnc</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>spice</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>egl-headless</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </graphics>
Aug 16 06:05:37 user nova-compute[74681]:     <video supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='modelType'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>vga</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>cirrus</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>vmvga</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>qxl</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>none</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>bochs</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>ramfb</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </video>
Aug 16 06:05:37 user nova-compute[74681]:     <hostdev supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='mode'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>subsystem</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='startupPolicy'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>default</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>mandatory</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>requisite</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>optional</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='subsysType'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>pci</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='capsType'/>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='pciBackend'/>
Aug 16 06:05:37 user nova-compute[74681]:     </hostdev>
Aug 16 06:05:37 user nova-compute[74681]:     <rng supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>random</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>egd</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>builtin</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </rng>
Aug 16 06:05:37 user nova-compute[74681]:     <filesystem supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='driverType'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>path</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>handle</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>virtiofs</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </filesystem>
Aug 16 06:05:37 user nova-compute[74681]:     <tpm supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>tpm-tis</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>tpm-crb</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>passthrough</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>emulator</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </tpm>
Aug 16 06:05:37 user nova-compute[74681]:   </devices>
Aug 16 06:05:37 user nova-compute[74681]:   <features>
Aug 16 06:05:37 user nova-compute[74681]:     <gic supported='no'/>
Aug 16 06:05:37 user nova-compute[74681]:     <vmcoreinfo supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:     <genid supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:     <backingStoreInput supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:     <backup supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:     <sev supported='no'/>
Aug 16 06:05:37 user nova-compute[74681]:   </features>
Aug 16 06:05:37 user nova-compute[74681]: </domainCapabilities>
Aug 16 06:05:37 user nova-compute[74681]:  {{(pid=74681) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 06:05:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 06:05:37 user nova-compute[74681]: <domainCapabilities>
Aug 16 06:05:37 user nova-compute[74681]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 06:05:37 user nova-compute[74681]:   <domain>kvm</domain>
Aug 16 06:05:37 user nova-compute[74681]:   <machine>pc-q35-6.2</machine>
Aug 16 06:05:37 user nova-compute[74681]:   <arch>i686</arch>
Aug 16 06:05:37 user nova-compute[74681]:   <vcpu max='288'/>
Aug 16 06:05:37 user nova-compute[74681]:   <iothreads supported='yes'/>
Aug 16 06:05:37 user nova-compute[74681]:   <os supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:     <enum name='firmware'/>
Aug 16 06:05:37 user nova-compute[74681]:     <loader supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>rom</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>pflash</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='readonly'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='secure'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </loader>
Aug 16 06:05:37 user nova-compute[74681]:   </os>
Aug 16 06:05:37 user nova-compute[74681]:   <cpu>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='host-passthrough' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='hostPassthroughMigratable'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='maximum' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <enum name='maximumMigratable'>
Aug 16 06:05:37 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:37 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:37 user nova-compute[74681]:       </enum>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='host-model' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 06:05:37 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ss'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='vmx'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='pcid'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='hypervisor'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='arat'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='umip'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='md-clear'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='stibp'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ssbd'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ibpb'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='ibrs'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='amd-stibp'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='erms'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 06:05:37 user nova-compute[74681]:       <feature policy='disable' name='lm'/>
Aug 16 06:05:37 user nova-compute[74681]:     </mode>
Aug 16 06:05:37 user nova-compute[74681]:     <mode name='custom' supported='yes'>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>qemu64</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>qemu32</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>phenom</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium3</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium2</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='yes'>pentium</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>n270</model>
Aug 16 06:05:37 user nova-compute[74681]:       <model usable='no'>kvm64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>coreduo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>core2duo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>athlon</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Westmere</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Snowridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Penryn</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G5</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G4</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G1</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Nehalem</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Rome</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Milan</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Dhyana</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cooperlake</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Conroe</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>486</model>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:   </cpu>
Aug 16 06:05:38 user nova-compute[74681]:   <memoryBacking supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='sourceType'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>file</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>anonymous</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>memfd</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:   </memoryBacking>
Aug 16 06:05:38 user nova-compute[74681]:   <devices>
Aug 16 06:05:38 user nova-compute[74681]:     <disk supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='diskDevice'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>disk</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cdrom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>floppy</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>lun</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='bus'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>fdc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sata</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </disk>
Aug 16 06:05:38 user nova-compute[74681]:     <graphics supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sdl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vnc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>spice</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egl-headless</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </graphics>
Aug 16 06:05:38 user nova-compute[74681]:     <video supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='modelType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cirrus</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vmvga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>qxl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>none</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>bochs</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ramfb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </video>
Aug 16 06:05:38 user nova-compute[74681]:     <hostdev supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='mode'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>subsystem</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='startupPolicy'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>default</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>mandatory</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>requisite</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>optional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='subsysType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pci</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='capsType'/>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='pciBackend'/>
Aug 16 06:05:38 user nova-compute[74681]:     </hostdev>
Aug 16 06:05:38 user nova-compute[74681]:     <rng supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>random</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egd</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>builtin</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </rng>
Aug 16 06:05:38 user nova-compute[74681]:     <filesystem supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='driverType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>path</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>handle</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtiofs</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </filesystem>
Aug 16 06:05:38 user nova-compute[74681]:     <tpm supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-tis</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-crb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>passthrough</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>emulator</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </tpm>
Aug 16 06:05:38 user nova-compute[74681]:   </devices>
Aug 16 06:05:38 user nova-compute[74681]:   <features>
Aug 16 06:05:38 user nova-compute[74681]:     <gic supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:     <vmcoreinfo supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <genid supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backingStoreInput supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backup supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <sev supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:   </features>
Aug 16 06:05:38 user nova-compute[74681]: </domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:  {{(pid=74681) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 06:05:38 user nova-compute[74681]: <domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 06:05:38 user nova-compute[74681]:   <domain>kvm</domain>
Aug 16 06:05:38 user nova-compute[74681]:   <machine>pc-i440fx-jammy</machine>
Aug 16 06:05:38 user nova-compute[74681]:   <arch>i686</arch>
Aug 16 06:05:38 user nova-compute[74681]:   <vcpu max='255'/>
Aug 16 06:05:38 user nova-compute[74681]:   <iothreads supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:   <os supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='firmware'/>
Aug 16 06:05:38 user nova-compute[74681]:     <loader supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>rom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pflash</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='readonly'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='secure'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </loader>
Aug 16 06:05:38 user nova-compute[74681]:   </os>
Aug 16 06:05:38 user nova-compute[74681]:   <cpu>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-passthrough' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='hostPassthroughMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='maximum' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='maximumMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-model' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ss'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='vmx'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pcid'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='hypervisor'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arat'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='umip'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='md-clear'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibpb'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibrs'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='erms'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='lm'/>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='custom' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>qemu64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>qemu32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>phenom</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>n270</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>kvm64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>coreduo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>core2duo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>athlon</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Westmere</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Snowridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Penryn</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G5</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G4</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G1</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Nehalem</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Rome</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Milan</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Dhyana</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cooperlake</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Conroe</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>486</model>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:   </cpu>
Aug 16 06:05:38 user nova-compute[74681]:   <memoryBacking supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='sourceType'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>file</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>anonymous</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>memfd</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:   </memoryBacking>
Aug 16 06:05:38 user nova-compute[74681]:   <devices>
Aug 16 06:05:38 user nova-compute[74681]:     <disk supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='diskDevice'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>disk</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cdrom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>floppy</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>lun</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='bus'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ide</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>fdc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sata</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </disk>
Aug 16 06:05:38 user nova-compute[74681]:     <graphics supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sdl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vnc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>spice</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egl-headless</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </graphics>
Aug 16 06:05:38 user nova-compute[74681]:     <video supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='modelType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cirrus</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vmvga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>qxl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>none</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>bochs</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ramfb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </video>
Aug 16 06:05:38 user nova-compute[74681]:     <hostdev supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='mode'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>subsystem</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='startupPolicy'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>default</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>mandatory</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>requisite</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>optional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='subsysType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pci</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='capsType'/>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='pciBackend'/>
Aug 16 06:05:38 user nova-compute[74681]:     </hostdev>
Aug 16 06:05:38 user nova-compute[74681]:     <rng supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>random</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egd</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>builtin</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </rng>
Aug 16 06:05:38 user nova-compute[74681]:     <filesystem supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='driverType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>path</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>handle</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtiofs</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </filesystem>
Aug 16 06:05:38 user nova-compute[74681]:     <tpm supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-tis</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-crb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>passthrough</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>emulator</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </tpm>
Aug 16 06:05:38 user nova-compute[74681]:   </devices>
Aug 16 06:05:38 user nova-compute[74681]:   <features>
Aug 16 06:05:38 user nova-compute[74681]:     <gic supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:     <vmcoreinfo supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <genid supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backingStoreInput supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backup supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <sev supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:   </features>
Aug 16 06:05:38 user nova-compute[74681]: </domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:  {{(pid=74681) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 06:05:38 user nova-compute[74681]: <domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 06:05:38 user nova-compute[74681]:   <domain>kvm</domain>
Aug 16 06:05:38 user nova-compute[74681]:   <machine>pc-i440fx-6.2</machine>
Aug 16 06:05:38 user nova-compute[74681]:   <arch>x86_64</arch>
Aug 16 06:05:38 user nova-compute[74681]:   <vcpu max='255'/>
Aug 16 06:05:38 user nova-compute[74681]:   <iothreads supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:   <os supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='firmware'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>efi</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:     <loader supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>rom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pflash</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='readonly'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='secure'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </loader>
Aug 16 06:05:38 user nova-compute[74681]:   </os>
Aug 16 06:05:38 user nova-compute[74681]:   <cpu>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-passthrough' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='hostPassthroughMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='maximum' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='maximumMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-model' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ss'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='vmx'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pcid'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='hypervisor'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arat'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='umip'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='md-clear'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='invtsc'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibpb'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibrs'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='rsba'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='erms'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='custom' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>qemu64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>qemu32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>phenom</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>n270</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>coreduo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>core2duo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>athlon</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Westmere</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Snowridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Penryn</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G5</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G4</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Opteron_G1</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Nehalem</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Rome</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Milan</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Dhyana</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cooperlake</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Conroe</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>486</model>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:   </cpu>
Aug 16 06:05:38 user nova-compute[74681]:   <memoryBacking supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='sourceType'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>file</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>anonymous</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>memfd</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:   </memoryBacking>
Aug 16 06:05:38 user nova-compute[74681]:   <devices>
Aug 16 06:05:38 user nova-compute[74681]:     <disk supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='diskDevice'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>disk</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cdrom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>floppy</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>lun</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='bus'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ide</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>fdc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sata</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </disk>
Aug 16 06:05:38 user nova-compute[74681]:     <graphics supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sdl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vnc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>spice</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egl-headless</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </graphics>
Aug 16 06:05:38 user nova-compute[74681]:     <video supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='modelType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cirrus</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vmvga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>qxl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>none</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>bochs</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ramfb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </video>
Aug 16 06:05:38 user nova-compute[74681]:     <hostdev supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='mode'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>subsystem</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='startupPolicy'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>default</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>mandatory</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>requisite</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>optional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='subsysType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pci</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='capsType'/>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='pciBackend'/>
Aug 16 06:05:38 user nova-compute[74681]:     </hostdev>
Aug 16 06:05:38 user nova-compute[74681]:     <rng supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>random</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egd</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>builtin</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </rng>
Aug 16 06:05:38 user nova-compute[74681]:     <filesystem supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='driverType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>path</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>handle</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtiofs</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </filesystem>
Aug 16 06:05:38 user nova-compute[74681]:     <tpm supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-tis</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-crb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>passthrough</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>emulator</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </tpm>
Aug 16 06:05:38 user nova-compute[74681]:   </devices>
Aug 16 06:05:38 user nova-compute[74681]:   <features>
Aug 16 06:05:38 user nova-compute[74681]:     <gic supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:     <vmcoreinfo supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <genid supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backingStoreInput supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backup supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <sev supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:   </features>
Aug 16 06:05:38 user nova-compute[74681]: </domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:  {{(pid=74681) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 06:05:38 user nova-compute[74681]: <domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 06:05:38 user nova-compute[74681]:   <domain>kvm</domain>
Aug 16 06:05:38 user nova-compute[74681]:   <machine>pc-q35-jammy</machine>
Aug 16 06:05:38 user nova-compute[74681]:   <arch>x86_64</arch>
Aug 16 06:05:38 user nova-compute[74681]:   <vcpu max='288'/>
Aug 16 06:05:38 user nova-compute[74681]:   <iothreads supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:   <os supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='firmware'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>efi</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:     <loader supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>rom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pflash</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='readonly'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='secure'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </loader>
Aug 16 06:05:38 user nova-compute[74681]:   </os>
Aug 16 06:05:38 user nova-compute[74681]:   <cpu>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-passthrough' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='hostPassthroughMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='maximum' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='maximumMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-model' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ss'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='vmx'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pcid'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='hypervisor'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arat'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='umip'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='md-clear'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='invtsc'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibpb'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibrs'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='rsba'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='erms'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='custom' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>qemu64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>qemu32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>phenom</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>n270</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>coreduo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>core2duo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>athlon</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Westmere</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Snowridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Penryn</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G5</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G4</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Opteron_G1</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Nehalem</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Rome</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Milan</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Dhyana</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cooperlake</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Conroe</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>486</model>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:   </cpu>
Aug 16 06:05:38 user nova-compute[74681]:   <memoryBacking supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='sourceType'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>file</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>anonymous</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>memfd</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:   </memoryBacking>
Aug 16 06:05:38 user nova-compute[74681]:   <devices>
Aug 16 06:05:38 user nova-compute[74681]:     <disk supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='diskDevice'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>disk</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cdrom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>floppy</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>lun</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='bus'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>fdc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sata</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </disk>
Aug 16 06:05:38 user nova-compute[74681]:     <graphics supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sdl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vnc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>spice</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egl-headless</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </graphics>
Aug 16 06:05:38 user nova-compute[74681]:     <video supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='modelType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cirrus</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vmvga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>qxl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>none</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>bochs</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ramfb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </video>
Aug 16 06:05:38 user nova-compute[74681]:     <hostdev supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='mode'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>subsystem</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='startupPolicy'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>default</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>mandatory</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>requisite</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>optional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='subsysType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pci</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='capsType'/>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='pciBackend'/>
Aug 16 06:05:38 user nova-compute[74681]:     </hostdev>
Aug 16 06:05:38 user nova-compute[74681]:     <rng supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>random</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egd</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>builtin</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </rng>
Aug 16 06:05:38 user nova-compute[74681]:     <filesystem supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='driverType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>path</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>handle</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtiofs</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </filesystem>
Aug 16 06:05:38 user nova-compute[74681]:     <tpm supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-tis</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-crb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>passthrough</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>emulator</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </tpm>
Aug 16 06:05:38 user nova-compute[74681]:   </devices>
Aug 16 06:05:38 user nova-compute[74681]:   <features>
Aug 16 06:05:38 user nova-compute[74681]:     <gic supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:     <vmcoreinfo supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <genid supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backingStoreInput supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backup supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <sev supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:   </features>
Aug 16 06:05:38 user nova-compute[74681]: </domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:  {{(pid=74681) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 06:05:38 user nova-compute[74681]: <domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 06:05:38 user nova-compute[74681]:   <domain>kvm</domain>
Aug 16 06:05:38 user nova-compute[74681]:   <machine>pc-q35-6.2</machine>
Aug 16 06:05:38 user nova-compute[74681]:   <arch>x86_64</arch>
Aug 16 06:05:38 user nova-compute[74681]:   <vcpu max='288'/>
Aug 16 06:05:38 user nova-compute[74681]:   <iothreads supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:   <os supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='firmware'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>efi</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:     <loader supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>rom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pflash</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='readonly'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='secure'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </loader>
Aug 16 06:05:38 user nova-compute[74681]:   </os>
Aug 16 06:05:38 user nova-compute[74681]:   <cpu>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-passthrough' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='hostPassthroughMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='maximum' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='maximumMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-model' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ss'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='vmx'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pcid'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='hypervisor'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arat'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='umip'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='md-clear'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='invtsc'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibpb'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibrs'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='rsba'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='erms'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='custom' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>qemu64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>qemu32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>phenom</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>n270</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>coreduo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>core2duo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>athlon</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Westmere</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Snowridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Penryn</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G5</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G4</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Opteron_G1</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Nehalem</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Rome</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Milan</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Dhyana</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cooperlake</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Conroe</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>486</model>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:   </cpu>
Aug 16 06:05:38 user nova-compute[74681]:   <memoryBacking supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='sourceType'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>file</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>anonymous</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>memfd</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:   </memoryBacking>
Aug 16 06:05:38 user nova-compute[74681]:   <devices>
Aug 16 06:05:38 user nova-compute[74681]:     <disk supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='diskDevice'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>disk</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cdrom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>floppy</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>lun</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='bus'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>fdc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sata</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </disk>
Aug 16 06:05:38 user nova-compute[74681]:     <graphics supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sdl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vnc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>spice</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egl-headless</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </graphics>
Aug 16 06:05:38 user nova-compute[74681]:     <video supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='modelType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cirrus</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vmvga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>qxl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>none</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>bochs</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ramfb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </video>
Aug 16 06:05:38 user nova-compute[74681]:     <hostdev supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='mode'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>subsystem</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='startupPolicy'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>default</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>mandatory</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>requisite</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>optional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='subsysType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pci</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='capsType'/>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='pciBackend'/>
Aug 16 06:05:38 user nova-compute[74681]:     </hostdev>
Aug 16 06:05:38 user nova-compute[74681]:     <rng supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>random</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egd</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>builtin</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </rng>
Aug 16 06:05:38 user nova-compute[74681]:     <filesystem supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='driverType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>path</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>handle</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtiofs</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </filesystem>
Aug 16 06:05:38 user nova-compute[74681]:     <tpm supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-tis</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-crb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>passthrough</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>emulator</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </tpm>
Aug 16 06:05:38 user nova-compute[74681]:   </devices>
Aug 16 06:05:38 user nova-compute[74681]:   <features>
Aug 16 06:05:38 user nova-compute[74681]:     <gic supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:     <vmcoreinfo supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <genid supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backingStoreInput supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backup supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <sev supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:   </features>
Aug 16 06:05:38 user nova-compute[74681]: </domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:  {{(pid=74681) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 06:05:38 user nova-compute[74681]: <domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 06:05:38 user nova-compute[74681]:   <domain>kvm</domain>
Aug 16 06:05:38 user nova-compute[74681]:   <machine>pc-i440fx-jammy</machine>
Aug 16 06:05:38 user nova-compute[74681]:   <arch>x86_64</arch>
Aug 16 06:05:38 user nova-compute[74681]:   <vcpu max='255'/>
Aug 16 06:05:38 user nova-compute[74681]:   <iothreads supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:   <os supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='firmware'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>efi</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:     <loader supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>rom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pflash</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='readonly'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>yes</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='secure'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>no</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </loader>
Aug 16 06:05:38 user nova-compute[74681]:   </os>
Aug 16 06:05:38 user nova-compute[74681]:   <cpu>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-passthrough' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='hostPassthroughMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='maximum' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='maximumMigratable'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>on</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>off</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='host-model' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <vendor>Intel</vendor>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ss'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='vmx'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pcid'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='hypervisor'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arat'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='umip'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='md-clear'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='invtsc'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibpb'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='ibrs'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-stibp'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='rsba'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='erms'/>
Aug 16 06:05:38 user nova-compute[74681]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:     <mode name='custom' supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>qemu64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>qemu32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>phenom</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>pentium</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>n270</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm64</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>kvm32</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>coreduo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>core2duo</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>athlon</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Westmere</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Snowridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Skylake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>SandyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Penryn</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G5</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G4</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G3</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Opteron_G2</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Opteron_G1</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Nehalem</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>IvyBridge</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Icelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Haswell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Rome</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-Milan</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>EPYC</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Dhyana</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cooperlake</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>Conroe</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='no'>Broadwell</model>
Aug 16 06:05:38 user nova-compute[74681]:       <model usable='yes'>486</model>
Aug 16 06:05:38 user nova-compute[74681]:     </mode>
Aug 16 06:05:38 user nova-compute[74681]:   </cpu>
Aug 16 06:05:38 user nova-compute[74681]:   <memoryBacking supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:     <enum name='sourceType'>
Aug 16 06:05:38 user nova-compute[74681]:       <value>file</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>anonymous</value>
Aug 16 06:05:38 user nova-compute[74681]:       <value>memfd</value>
Aug 16 06:05:38 user nova-compute[74681]:     </enum>
Aug 16 06:05:38 user nova-compute[74681]:   </memoryBacking>
Aug 16 06:05:38 user nova-compute[74681]:   <devices>
Aug 16 06:05:38 user nova-compute[74681]:     <disk supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='diskDevice'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>disk</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cdrom</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>floppy</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>lun</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='bus'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ide</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>fdc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sata</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </disk>
Aug 16 06:05:38 user nova-compute[74681]:     <graphics supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='type'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>sdl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vnc</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>spice</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egl-headless</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </graphics>
Aug 16 06:05:38 user nova-compute[74681]:     <video supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='modelType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>cirrus</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>vmvga</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>qxl</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>none</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>bochs</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>ramfb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </video>
Aug 16 06:05:38 user nova-compute[74681]:     <hostdev supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='mode'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>subsystem</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='startupPolicy'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>default</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>mandatory</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>requisite</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>optional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='subsysType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>usb</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>pci</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>scsi</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='capsType'/>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='pciBackend'/>
Aug 16 06:05:38 user nova-compute[74681]:     </hostdev>
Aug 16 06:05:38 user nova-compute[74681]:     <rng supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtio-non-transitional</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>random</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>egd</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>builtin</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </rng>
Aug 16 06:05:38 user nova-compute[74681]:     <filesystem supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='driverType'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>path</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>handle</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>virtiofs</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </filesystem>
Aug 16 06:05:38 user nova-compute[74681]:     <tpm supported='yes'>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='model'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-tis</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>tpm-crb</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:       <enum name='backendModel'>
Aug 16 06:05:38 user nova-compute[74681]:         <value>passthrough</value>
Aug 16 06:05:38 user nova-compute[74681]:         <value>emulator</value>
Aug 16 06:05:38 user nova-compute[74681]:       </enum>
Aug 16 06:05:38 user nova-compute[74681]:     </tpm>
Aug 16 06:05:38 user nova-compute[74681]:   </devices>
Aug 16 06:05:38 user nova-compute[74681]:   <features>
Aug 16 06:05:38 user nova-compute[74681]:     <gic supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:     <vmcoreinfo supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <genid supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backingStoreInput supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <backup supported='yes'/>
Aug 16 06:05:38 user nova-compute[74681]:     <sev supported='no'/>
Aug 16 06:05:38 user nova-compute[74681]:   </features>
Aug 16 06:05:38 user nova-compute[74681]: </domainCapabilities>
Aug 16 06:05:38 user nova-compute[74681]:  {{(pid=74681) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74681) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74681) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Checking secure boot support for host arch (x86_64) {{(pid=74681) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Checking secure boot support for host arch (x86_64) {{(pid=74681) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Checking secure boot support for host arch (x86_64) {{(pid=74681) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 06:05:38 user nova-compute[74681]: INFO nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Secure Boot support detected
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] cpu compare xml: <cpu match="exact">
Aug 16 06:05:38 user nova-compute[74681]:   <model>Nehalem</model>
Aug 16 06:05:38 user nova-compute[74681]: </cpu>
Aug 16 06:05:38 user nova-compute[74681]:  {{(pid=74681) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 06:05:38 user nova-compute[74681]: INFO nova.virt.node [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Generated node identity 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c
Aug 16 06:05:38 user nova-compute[74681]: INFO nova.virt.node [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Wrote node identity 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c to /opt/stack/data/nova/compute_id
Aug 16 06:05:38 user nova-compute[74681]: WARNING nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Compute nodes ['9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 06:05:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 06:05:38 user nova-compute[74681]: WARNING nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 06:05:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:05:38 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:05:38 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Hypervisor/Node resource view: name=user free_ram=10674MB free_disk=25.431381225585938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:05:38 user nova-compute[74681]: WARNING nova.compute.resource_tracker [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] No compute node record for user:9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c could not be found.
Aug 16 06:05:38 user nova-compute[74681]: INFO nova.compute.resource_tracker [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Compute node record created for user:user with uuid: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:05:38 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:05:39 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [req-d0bb1438-bd45-4eb1-a6dd-c6e9544f5948] Created resource provider record via placement API for resource provider with UUID 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c and name user.
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74681) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 06:05:39 user nova-compute[74681]: INFO nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] kernel doesn't support AMD SEV
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Libvirt baseline CPU <cpu>
Aug 16 06:05:39 user nova-compute[74681]:   <arch>x86_64</arch>
Aug 16 06:05:39 user nova-compute[74681]:   <model>Nehalem</model>
Aug 16 06:05:39 user nova-compute[74681]:   <vendor>Intel</vendor>
Aug 16 06:05:39 user nova-compute[74681]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 06:05:39 user nova-compute[74681]: </cpu>
Aug 16 06:05:39 user nova-compute[74681]:  {{(pid=74681) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Updated inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Updating resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c generation from 0 to 1 during operation: update_inventory {{(pid=74681) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Updating resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c generation from 1 to 2 during operation: update_traits {{(pid=74681) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.721s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.service [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Creating RPC server for service compute {{(pid=74681) start /opt/stack/nova/nova/service.py:182}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.service [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Join ServiceGroup membership for this service compute {{(pid=74681) start /opt/stack/nova/nova/service.py:199}}
Aug 16 06:05:39 user nova-compute[74681]: DEBUG nova.servicegroup.drivers.db [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74681) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 06:05:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:05:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Didn't find any instances for network info cache update. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:06:28 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:06:28 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=10075MB free_disk=25.439510345458984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:06:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:07:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:07:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:07:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Didn't find any instances for network info cache update. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 06:07:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:07:29 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:07:29 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:07:29 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=10017MB free_disk=25.33084487915039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:07:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:07:30 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:08:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:08:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Didn't find any instances for network info cache update. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 06:08:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:29 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:29 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:29 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:08:30 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:08:30 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:08:30 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=10053MB free_disk=25.438861846923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:08:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:08:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:08:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:09:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:30 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:30 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:09:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:09:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Didn't find any instances for network info cache update. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:09:31 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:09:31 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:09:31 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=9394MB free_disk=26.146221160888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:09:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:33 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:33 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:09:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:09:42 user nova-compute[74681]: INFO nova.compute.claims [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Claim successful on node user
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:09:42 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:09:42 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Creating image(s)
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "/opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "/opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "/opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG nova.policy [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f41156e5aac4c49b8d79b28fe9759d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4497e1bbb04a6badebffb1fe54b82a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG nova.virt.images [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] 89d7f25c-29d1-41cf-9690-6814b446c3b9 was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe.part /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe.part /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe.converted" returned: 0 in 0.499s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.959s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:44 user nova-compute[74681]: INFO oslo.privsep.daemon [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb3wvo6gv/privsep.sock']
Aug 16 06:09:44 user sudo[119112]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb3wvo6gv/privsep.sock
Aug 16 06:09:44 user sudo[119112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 06:09:46 user sudo[119112]: pam_unix(sudo:session): session closed for user root
Aug 16 06:09:46 user nova-compute[74681]: INFO oslo.privsep.daemon [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Spawned new privsep daemon via rootwrap
Aug 16 06:09:46 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 06:09:46 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 06:09:46 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 06:09:46 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 119118
Aug 16 06:09:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.166s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk 1073741824" returned: 0 in 0.045s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.215s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Cannot resize image /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lazy-loading 'migration_context' on Instance uuid 02e364f9-af4e-40bb-a0b4-2b1864f54270 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Ensure instance console log exists: /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Successfully created port: 88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:09:47 user nova-compute[74681]: INFO nova.compute.claims [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Claim successful on node user
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.network.neutron [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:09:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:09:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Creating image(s)
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "/opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "/opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.policy [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de61ce701f0b41fdb80225fc0ff05fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c0bd15a5644f4f92453e4706aef46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.149s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.151s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk 1073741824" returned: 0 in 0.057s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.150s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:09:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:49 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Cannot resize image /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:09:49 user nova-compute[74681]: DEBUG nova.objects.instance [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'migration_context' on Instance uuid 3fa19b27-7628-44ce-b0ae-e1e870337855 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:09:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:09:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Ensure instance console log exists: /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:09:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:50 user nova-compute[74681]: DEBUG nova.network.neutron [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Successfully created port: a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:09:51 user nova-compute[74681]: INFO nova.compute.claims [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Claim successful on node user
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.network.neutron [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:09:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:09:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Creating image(s)
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "/opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "/opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "/opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.168s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:51 user nova-compute[74681]: DEBUG nova.policy [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2e5fe13505244ef92353a7ba756551c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b3563d8bdb54a0aa3862684760dbe3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk 1073741824" returned: 0 in 0.043s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Successfully updated port: 88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquired lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.164s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-e61fa27a-f7a6-4987-b8b1-bf4ea1a5dd4a req-8b1639b8-2473-435c-8793-b67fb66a655f service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received event network-changed-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-e61fa27a-f7a6-4987-b8b1-bf4ea1a5dd4a req-8b1639b8-2473-435c-8793-b67fb66a655f service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Refreshing instance network info cache due to event network-changed-88cb26c3-ded5-42e9-83a4-8f3c66726dfd. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e61fa27a-f7a6-4987-b8b1-bf4ea1a5dd4a req-8b1639b8-2473-435c-8793-b67fb66a655f service nova] Acquiring lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Cannot resize image /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.objects.instance [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lazy-loading 'migration_context' on Instance uuid 70390b89-fdfb-4552-98e5-35568c0268bc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Ensure instance console log exists: /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updating instance_info_cache with network_info: [{"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Releasing lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Instance network_info: |[{"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e61fa27a-f7a6-4987-b8b1-bf4ea1a5dd4a req-8b1639b8-2473-435c-8793-b67fb66a655f service nova] Acquired lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.network.neutron [req-e61fa27a-f7a6-4987-b8b1-bf4ea1a5dd4a req-8b1639b8-2473-435c-8793-b67fb66a655f service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Refreshing network info cache for port 88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Start _get_guest_xml network_info=[{"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:09:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:09:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-458531903',display_name='tempest-ServersNegativeTestJSON-server-458531903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-458531903',id=1,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4497e1bbb04a6badebffb1fe54b82a',ramdisk_id='',reservation_id='r-wm026m32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1958763636',owner_user_name='tempest-ServersNegativeTestJSON-1958763636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:43Z,user_data=None,user_id='9f41156e5aac4c49b8d79b28fe9759d9',uuid=02e364f9-af4e-40bb-a0b4-2b1864f54270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converting VIF {"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=88cb26c3-ded5-42e9-83a4-8f3c66726dfd,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88cb26c3-de') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lazy-loading 'pci_devices' on Instance uuid 02e364f9-af4e-40bb-a0b4-2b1864f54270 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:09:53 user nova-compute[74681]:   <uuid>02e364f9-af4e-40bb-a0b4-2b1864f54270</uuid>
Aug 16 06:09:53 user nova-compute[74681]:   <name>instance-00000001</name>
Aug 16 06:09:53 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:09:53 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:09:53 user nova-compute[74681]:   <metadata>
Aug 16 06:09:53 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:09:53 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:09:53 user nova-compute[74681]:       <nova:name>tempest-ServersNegativeTestJSON-server-458531903</nova:name>
Aug 16 06:09:53 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:09:53</nova:creationTime>
Aug 16 06:09:53 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:09:53 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:09:53 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:09:53 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:09:53 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:09:53 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:09:53 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:09:53 user nova-compute[74681]:       <nova:owner>
Aug 16 06:09:53 user nova-compute[74681]:         <nova:user uuid="9f41156e5aac4c49b8d79b28fe9759d9">tempest-ServersNegativeTestJSON-1958763636-project-member</nova:user>
Aug 16 06:09:53 user nova-compute[74681]:         <nova:project uuid="3c4497e1bbb04a6badebffb1fe54b82a">tempest-ServersNegativeTestJSON-1958763636</nova:project>
Aug 16 06:09:53 user nova-compute[74681]:       </nova:owner>
Aug 16 06:09:53 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:09:53 user nova-compute[74681]:       <nova:ports>
Aug 16 06:09:53 user nova-compute[74681]:         <nova:port uuid="88cb26c3-ded5-42e9-83a4-8f3c66726dfd">
Aug 16 06:09:53 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:09:53 user nova-compute[74681]:         </nova:port>
Aug 16 06:09:53 user nova-compute[74681]:       </nova:ports>
Aug 16 06:09:53 user nova-compute[74681]:     </nova:instance>
Aug 16 06:09:53 user nova-compute[74681]:   </metadata>
Aug 16 06:09:53 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:09:53 user nova-compute[74681]:     <system>
Aug 16 06:09:53 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:09:53 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:09:53 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:09:53 user nova-compute[74681]:       <entry name="serial">02e364f9-af4e-40bb-a0b4-2b1864f54270</entry>
Aug 16 06:09:53 user nova-compute[74681]:       <entry name="uuid">02e364f9-af4e-40bb-a0b4-2b1864f54270</entry>
Aug 16 06:09:53 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:09:53 user nova-compute[74681]:     </system>
Aug 16 06:09:53 user nova-compute[74681]:   </sysinfo>
Aug 16 06:09:53 user nova-compute[74681]:   <os>
Aug 16 06:09:53 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:09:53 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:09:53 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:09:53 user nova-compute[74681]:   </os>
Aug 16 06:09:53 user nova-compute[74681]:   <features>
Aug 16 06:09:53 user nova-compute[74681]:     <acpi/>
Aug 16 06:09:53 user nova-compute[74681]:     <apic/>
Aug 16 06:09:53 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:09:53 user nova-compute[74681]:   </features>
Aug 16 06:09:53 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:09:53 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:09:53 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:09:53 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:09:53 user nova-compute[74681]:   </clock>
Aug 16 06:09:53 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:09:53 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:09:53 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:09:53 user nova-compute[74681]:   </cpu>
Aug 16 06:09:53 user nova-compute[74681]:   <devices>
Aug 16 06:09:53 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:09:53 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:09:53 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk"/>
Aug 16 06:09:53 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:09:53 user nova-compute[74681]:     </disk>
Aug 16 06:09:53 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:09:53 user nova-compute[74681]:       <mac address="fa:16:3e:79:0f:bc"/>
Aug 16 06:09:53 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:09:53 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:09:53 user nova-compute[74681]:       <target dev="tap88cb26c3-de"/>
Aug 16 06:09:53 user nova-compute[74681]:     </interface>
Aug 16 06:09:53 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:09:53 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/console.log" append="off"/>
Aug 16 06:09:53 user nova-compute[74681]:     </serial>
Aug 16 06:09:53 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:09:53 user nova-compute[74681]:     <video>
Aug 16 06:09:53 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:09:53 user nova-compute[74681]:     </video>
Aug 16 06:09:53 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:09:53 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:09:53 user nova-compute[74681]:     </rng>
Aug 16 06:09:53 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:09:53 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:09:53 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:09:53 user nova-compute[74681]:     </memballoon>
Aug 16 06:09:53 user nova-compute[74681]:   </devices>
Aug 16 06:09:53 user nova-compute[74681]: </domain>
Aug 16 06:09:53 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-458531903',display_name='tempest-ServersNegativeTestJSON-server-458531903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-458531903',id=1,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4497e1bbb04a6badebffb1fe54b82a',ramdisk_id='',reservation_id='r-wm026m32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1958763636',owner_user_name='tempest-ServersNegativeTestJSON-1958763636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:43Z,user_data=None,user_id='9f41156e5aac4c49b8d79b28fe9759d9',uuid=02e364f9-af4e-40bb-a0b4-2b1864f54270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converting VIF {"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=88cb26c3-ded5-42e9-83a4-8f3c66726dfd,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88cb26c3-de') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG os_vif [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=88cb26c3-ded5-42e9-83a4-8f3c66726dfd,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88cb26c3-de') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Created schema index Interface.name {{(pid=74681) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Created schema index Port.name {{(pid=74681) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Created schema index Bridge.name {{(pid=74681) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [POLLOUT] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:09:53 user nova-compute[74681]: INFO oslo.privsep.daemon [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpxwf18_p7/privsep.sock']
Aug 16 06:09:53 user sudo[119188]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpxwf18_p7/privsep.sock
Aug 16 06:09:53 user sudo[119188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 06:09:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.network.neutron [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Successfully updated port: a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquired lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.network.neutron [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.network.neutron [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.compute.manager [req-d480d3eb-d1a6-4e90-b9d2-5d6f316ec103 req-5bb7836c-1d1a-4728-a9c3-20b3f142e6bd service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received event network-changed-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.compute.manager [req-d480d3eb-d1a6-4e90-b9d2-5d6f316ec103 req-5bb7836c-1d1a-4728-a9c3-20b3f142e6bd service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Refreshing instance network info cache due to event network-changed-a62d2031-a7e7-4e14-91ce-11c5603ce3b4. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d480d3eb-d1a6-4e90-b9d2-5d6f316ec103 req-5bb7836c-1d1a-4728-a9c3-20b3f142e6bd service nova] Acquiring lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:09:54 user nova-compute[74681]: INFO nova.compute.claims [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Claim successful on node user
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:09:55 user nova-compute[74681]: INFO nova.compute.claims [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Claim successful on node user
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:09:55 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.neutron [req-e61fa27a-f7a6-4987-b8b1-bf4ea1a5dd4a req-8b1639b8-2473-435c-8793-b67fb66a655f service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updated VIF entry in instance network info cache for port 88cb26c3-ded5-42e9-83a4-8f3c66726dfd. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.neutron [req-e61fa27a-f7a6-4987-b8b1-bf4ea1a5dd4a req-8b1639b8-2473-435c-8793-b67fb66a655f service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updating instance_info_cache with network_info: [{"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Successfully created port: d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e61fa27a-f7a6-4987-b8b1-bf4ea1a5dd4a req-8b1639b8-2473-435c-8793-b67fb66a655f service nova] Releasing lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:09:55 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Creating image(s)
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:55 user sudo[119188]: pam_unix(sudo:session): session closed for user root
Aug 16 06:09:55 user nova-compute[74681]: INFO oslo.privsep.daemon [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Spawned new privsep daemon via rootwrap
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updating instance_info_cache with network_info: [{"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:09:55 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 06:09:55 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 06:09:55 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 06:09:55 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 119192
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Releasing lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Instance network_info: |[{"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d480d3eb-d1a6-4e90-b9d2-5d6f316ec103 req-5bb7836c-1d1a-4728-a9c3-20b3f142e6bd service nova] Acquired lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.neutron [req-d480d3eb-d1a6-4e90-b9d2-5d6f316ec103 req-5bb7836c-1d1a-4728-a9c3-20b3f142e6bd service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Refreshing network info cache for port a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Start _get_guest_xml network_info=[{"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.policy [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b24840d59e14692a62430236835c592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2558af74dc4c419b153219d7149dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:09:55 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:09:55 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000737702',display_name='tempest-AttachVolumeNegativeTest-server-2000737702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000737702',id=2,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxf60vy083dcqDmgKQudfQGFIjNhV71YHeGyBxF0QbvR7KaBEfWovDXqSocEkAHTAC/AAwWpgQ2vEERRiSm5ff+pBQb6MXlJAtj393eFHEdYzSA0EfpEeCYF5MQQsj2RQ==',key_name='tempest-keypair-2001252791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-9fs7luon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=3fa19b27-7628-44ce-b0ae-e1e870337855,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:1c:19,bridge_name='br-int',has_traffic_filtering=True,id=a62d2031-a7e7-4e14-91ce-11c5603ce3b4,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62d2031-a7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.objects.instance [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fa19b27-7628-44ce-b0ae-e1e870337855 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:09:55 user nova-compute[74681]:   <uuid>3fa19b27-7628-44ce-b0ae-e1e870337855</uuid>
Aug 16 06:09:55 user nova-compute[74681]:   <name>instance-00000002</name>
Aug 16 06:09:55 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:09:55 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:09:55 user nova-compute[74681]:   <metadata>
Aug 16 06:09:55 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:09:55 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:09:55 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2000737702</nova:name>
Aug 16 06:09:55 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:09:55</nova:creationTime>
Aug 16 06:09:55 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:09:55 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:09:55 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:09:55 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:09:55 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:09:55 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:09:55 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:09:55 user nova-compute[74681]:       <nova:owner>
Aug 16 06:09:55 user nova-compute[74681]:         <nova:user uuid="de61ce701f0b41fdb80225fc0ff05fac">tempest-AttachVolumeNegativeTest-1322537387-project-member</nova:user>
Aug 16 06:09:55 user nova-compute[74681]:         <nova:project uuid="74c0bd15a5644f4f92453e4706aef46d">tempest-AttachVolumeNegativeTest-1322537387</nova:project>
Aug 16 06:09:55 user nova-compute[74681]:       </nova:owner>
Aug 16 06:09:55 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:09:55 user nova-compute[74681]:       <nova:ports>
Aug 16 06:09:55 user nova-compute[74681]:         <nova:port uuid="a62d2031-a7e7-4e14-91ce-11c5603ce3b4">
Aug 16 06:09:55 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:09:55 user nova-compute[74681]:         </nova:port>
Aug 16 06:09:55 user nova-compute[74681]:       </nova:ports>
Aug 16 06:09:55 user nova-compute[74681]:     </nova:instance>
Aug 16 06:09:55 user nova-compute[74681]:   </metadata>
Aug 16 06:09:55 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:09:55 user nova-compute[74681]:     <system>
Aug 16 06:09:55 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:09:55 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:09:55 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:09:55 user nova-compute[74681]:       <entry name="serial">3fa19b27-7628-44ce-b0ae-e1e870337855</entry>
Aug 16 06:09:55 user nova-compute[74681]:       <entry name="uuid">3fa19b27-7628-44ce-b0ae-e1e870337855</entry>
Aug 16 06:09:55 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:09:55 user nova-compute[74681]:     </system>
Aug 16 06:09:55 user nova-compute[74681]:   </sysinfo>
Aug 16 06:09:55 user nova-compute[74681]:   <os>
Aug 16 06:09:55 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:09:55 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:09:55 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:09:55 user nova-compute[74681]:   </os>
Aug 16 06:09:55 user nova-compute[74681]:   <features>
Aug 16 06:09:55 user nova-compute[74681]:     <acpi/>
Aug 16 06:09:55 user nova-compute[74681]:     <apic/>
Aug 16 06:09:55 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:09:55 user nova-compute[74681]:   </features>
Aug 16 06:09:55 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:09:55 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:09:55 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:09:55 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:09:55 user nova-compute[74681]:   </clock>
Aug 16 06:09:55 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:09:55 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:09:55 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:09:55 user nova-compute[74681]:   </cpu>
Aug 16 06:09:55 user nova-compute[74681]:   <devices>
Aug 16 06:09:55 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:09:55 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:09:55 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk"/>
Aug 16 06:09:55 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:09:55 user nova-compute[74681]:     </disk>
Aug 16 06:09:55 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:09:55 user nova-compute[74681]:       <mac address="fa:16:3e:ec:1c:19"/>
Aug 16 06:09:55 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:09:55 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:09:55 user nova-compute[74681]:       <target dev="tapa62d2031-a7"/>
Aug 16 06:09:55 user nova-compute[74681]:     </interface>
Aug 16 06:09:55 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:09:55 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/console.log" append="off"/>
Aug 16 06:09:55 user nova-compute[74681]:     </serial>
Aug 16 06:09:55 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:09:55 user nova-compute[74681]:     <video>
Aug 16 06:09:55 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:09:55 user nova-compute[74681]:     </video>
Aug 16 06:09:55 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:09:55 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:09:55 user nova-compute[74681]:     </rng>
Aug 16 06:09:55 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:09:55 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:09:55 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:09:55 user nova-compute[74681]:     </memballoon>
Aug 16 06:09:55 user nova-compute[74681]:   </devices>
Aug 16 06:09:55 user nova-compute[74681]: </domain>
Aug 16 06:09:55 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000737702',display_name='tempest-AttachVolumeNegativeTest-server-2000737702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000737702',id=2,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxf60vy083dcqDmgKQudfQGFIjNhV71YHeGyBxF0QbvR7KaBEfWovDXqSocEkAHTAC/AAwWpgQ2vEERRiSm5ff+pBQb6MXlJAtj393eFHEdYzSA0EfpEeCYF5MQQsj2RQ==',key_name='tempest-keypair-2001252791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-9fs7luon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=3fa19b27-7628-44ce-b0ae-e1e870337855,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:1c:19,bridge_name='br-int',has_traffic_filtering=True,id=a62d2031-a7e7-4e14-91ce-11c5603ce3b4,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62d2031-a7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG os_vif [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:1c:19,bridge_name='br-int',has_traffic_filtering=True,id=a62d2031-a7e7-4e14-91ce-11c5603ce3b4,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62d2031-a7') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.170s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:09:55 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk 1073741824" returned: 0 in 0.040s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:09:55 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Creating image(s)
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.202s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa62d2031-a7, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa62d2031-a7, col_values=(('external_ids', {'iface-id': 'a62d2031-a7e7-4e14-91ce-11c5603ce3b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:1c:19', 'vm-uuid': '3fa19b27-7628-44ce-b0ae-e1e870337855'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:56 user nova-compute[74681]: INFO os_vif [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:1c:19,bridge_name='br-int',has_traffic_filtering=True,id=a62d2031-a7e7-4e14-91ce-11c5603ce3b4,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62d2031-a7')
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88cb26c3-de, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88cb26c3-de, col_values=(('external_ids', {'iface-id': '88cb26c3-ded5-42e9-83a4-8f3c66726dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:0f:bc', 'vm-uuid': '02e364f9-af4e-40bb-a0b4-2b1864f54270'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:56 user nova-compute[74681]: INFO os_vif [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=88cb26c3-ded5-42e9-83a4-8f3c66726dfd,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88cb26c3-de')
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No VIF found with MAC fa:16:3e:ec:1c:19, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] No VIF found with MAC fa:16:3e:79:0f:bc, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Cannot resize image /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'migration_context' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Ensure instance console log exists: /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.158s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk 1073741824" returned: 0 in 0.045s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.policy [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e9ea2042eae46618172633ecf40bb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed7ef3df024e178e16f79008239e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Cannot resize image /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'migration_context' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Ensure instance console log exists: /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:09:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG nova.network.neutron [req-d480d3eb-d1a6-4e90-b9d2-5d6f316ec103 req-5bb7836c-1d1a-4728-a9c3-20b3f142e6bd service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updated VIF entry in instance network info cache for port a62d2031-a7e7-4e14-91ce-11c5603ce3b4. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG nova.network.neutron [req-d480d3eb-d1a6-4e90-b9d2-5d6f316ec103 req-5bb7836c-1d1a-4728-a9c3-20b3f142e6bd service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updating instance_info_cache with network_info: [{"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d480d3eb-d1a6-4e90-b9d2-5d6f316ec103 req-5bb7836c-1d1a-4728-a9c3-20b3f142e6bd service nova] Releasing lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Successfully updated port: d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquired lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-a3285244-fcf8-4e88-be47-ccce821d56d8 req-928c862f-580c-413b-a6f2-de1bff491b34 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received event network-changed-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-a3285244-fcf8-4e88-be47-ccce821d56d8 req-928c862f-580c-413b-a6f2-de1bff491b34 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Refreshing instance network info cache due to event network-changed-d431340f-a0ca-42db-aa2d-0a1a0e885c9c. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:09:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3285244-fcf8-4e88-be47-ccce821d56d8 req-928c862f-580c-413b-a6f2-de1bff491b34 service nova] Acquiring lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating instance_info_cache with network_info: [{"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Releasing lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance network_info: |[{"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3285244-fcf8-4e88-be47-ccce821d56d8 req-928c862f-580c-413b-a6f2-de1bff491b34 service nova] Acquired lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.network.neutron [req-a3285244-fcf8-4e88-be47-ccce821d56d8 req-928c862f-580c-413b-a6f2-de1bff491b34 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Refreshing network info cache for port d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Start _get_guest_xml network_info=[{"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:09:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-531426131',display_name='tempest-ServerActionsTestOtherB-server-531426131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-531426131',id=3,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWlIoTicQCRzN4ho+jH6G0ba9amolIyK2LT+pFMzFui3SxetiZZayKLGlFWxVg76CqjpfkgyxdZS4PxM2hlDKSKmqhhIQRwcBAryoq1HKw9nWQttQnXQLtyPZgNVZBs/A==',key_name='tempest-keypair-1862071311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b3563d8bdb54a0aa3862684760dbe3e',ramdisk_id='',reservation_id='r-i4lgm6v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1555615278',owner_user_name='tempest-ServerActionsTestOtherB-1555615278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2e5fe13505244ef92353a7ba756551c',uuid=70390b89-fdfb-4552-98e5-35568c0268bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Converting VIF {"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.objects.instance [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lazy-loading 'pci_devices' on Instance uuid 70390b89-fdfb-4552-98e5-35568c0268bc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:09:58 user nova-compute[74681]:   <uuid>70390b89-fdfb-4552-98e5-35568c0268bc</uuid>
Aug 16 06:09:58 user nova-compute[74681]:   <name>instance-00000003</name>
Aug 16 06:09:58 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:09:58 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:09:58 user nova-compute[74681]:   <metadata>
Aug 16 06:09:58 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:09:58 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:09:58 user nova-compute[74681]:       <nova:name>tempest-ServerActionsTestOtherB-server-531426131</nova:name>
Aug 16 06:09:58 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:09:58</nova:creationTime>
Aug 16 06:09:58 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:09:58 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:09:58 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:09:58 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:09:58 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:09:58 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:09:58 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:09:58 user nova-compute[74681]:       <nova:owner>
Aug 16 06:09:58 user nova-compute[74681]:         <nova:user uuid="b2e5fe13505244ef92353a7ba756551c">tempest-ServerActionsTestOtherB-1555615278-project-member</nova:user>
Aug 16 06:09:58 user nova-compute[74681]:         <nova:project uuid="8b3563d8bdb54a0aa3862684760dbe3e">tempest-ServerActionsTestOtherB-1555615278</nova:project>
Aug 16 06:09:58 user nova-compute[74681]:       </nova:owner>
Aug 16 06:09:58 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:09:58 user nova-compute[74681]:       <nova:ports>
Aug 16 06:09:58 user nova-compute[74681]:         <nova:port uuid="d431340f-a0ca-42db-aa2d-0a1a0e885c9c">
Aug 16 06:09:58 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 06:09:58 user nova-compute[74681]:         </nova:port>
Aug 16 06:09:58 user nova-compute[74681]:       </nova:ports>
Aug 16 06:09:58 user nova-compute[74681]:     </nova:instance>
Aug 16 06:09:58 user nova-compute[74681]:   </metadata>
Aug 16 06:09:58 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:09:58 user nova-compute[74681]:     <system>
Aug 16 06:09:58 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:09:58 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:09:58 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:09:58 user nova-compute[74681]:       <entry name="serial">70390b89-fdfb-4552-98e5-35568c0268bc</entry>
Aug 16 06:09:58 user nova-compute[74681]:       <entry name="uuid">70390b89-fdfb-4552-98e5-35568c0268bc</entry>
Aug 16 06:09:58 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:09:58 user nova-compute[74681]:     </system>
Aug 16 06:09:58 user nova-compute[74681]:   </sysinfo>
Aug 16 06:09:58 user nova-compute[74681]:   <os>
Aug 16 06:09:58 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:09:58 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:09:58 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:09:58 user nova-compute[74681]:   </os>
Aug 16 06:09:58 user nova-compute[74681]:   <features>
Aug 16 06:09:58 user nova-compute[74681]:     <acpi/>
Aug 16 06:09:58 user nova-compute[74681]:     <apic/>
Aug 16 06:09:58 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:09:58 user nova-compute[74681]:   </features>
Aug 16 06:09:58 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:09:58 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:09:58 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:09:58 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:09:58 user nova-compute[74681]:   </clock>
Aug 16 06:09:58 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:09:58 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:09:58 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:09:58 user nova-compute[74681]:   </cpu>
Aug 16 06:09:58 user nova-compute[74681]:   <devices>
Aug 16 06:09:58 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:09:58 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:09:58 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk"/>
Aug 16 06:09:58 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:09:58 user nova-compute[74681]:     </disk>
Aug 16 06:09:58 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:09:58 user nova-compute[74681]:       <mac address="fa:16:3e:95:96:98"/>
Aug 16 06:09:58 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:09:58 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:09:58 user nova-compute[74681]:       <target dev="tapd431340f-a0"/>
Aug 16 06:09:58 user nova-compute[74681]:     </interface>
Aug 16 06:09:58 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:09:58 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/console.log" append="off"/>
Aug 16 06:09:58 user nova-compute[74681]:     </serial>
Aug 16 06:09:58 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:09:58 user nova-compute[74681]:     <video>
Aug 16 06:09:58 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:09:58 user nova-compute[74681]:     </video>
Aug 16 06:09:58 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:09:58 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:09:58 user nova-compute[74681]:     </rng>
Aug 16 06:09:58 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:09:58 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:09:58 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:09:58 user nova-compute[74681]:     </memballoon>
Aug 16 06:09:58 user nova-compute[74681]:   </devices>
Aug 16 06:09:58 user nova-compute[74681]: </domain>
Aug 16 06:09:58 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-531426131',display_name='tempest-ServerActionsTestOtherB-server-531426131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-531426131',id=3,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWlIoTicQCRzN4ho+jH6G0ba9amolIyK2LT+pFMzFui3SxetiZZayKLGlFWxVg76CqjpfkgyxdZS4PxM2hlDKSKmqhhIQRwcBAryoq1HKw9nWQttQnXQLtyPZgNVZBs/A==',key_name='tempest-keypair-1862071311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b3563d8bdb54a0aa3862684760dbe3e',ramdisk_id='',reservation_id='r-i4lgm6v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1555615278',owner_user_name='tempest-ServerActionsTestOtherB-1555615278-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2e5fe13505244ef92353a7ba756551c',uuid=70390b89-fdfb-4552-98e5-35568c0268bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Converting VIF {"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG os_vif [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd431340f-a0, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd431340f-a0, col_values=(('external_ids', {'iface-id': 'd431340f-a0ca-42db-aa2d-0a1a0e885c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:96:98', 'vm-uuid': '70390b89-fdfb-4552-98e5-35568c0268bc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: INFO os_vif [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0')
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] No VIF found with MAC fa:16:3e:95:96:98, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:09:59 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Successfully created port: cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:09:59 user nova-compute[74681]: DEBUG nova.network.neutron [req-a3285244-fcf8-4e88-be47-ccce821d56d8 req-928c862f-580c-413b-a6f2-de1bff491b34 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updated VIF entry in instance network info cache for port d431340f-a0ca-42db-aa2d-0a1a0e885c9c. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:09:59 user nova-compute[74681]: DEBUG nova.network.neutron [req-a3285244-fcf8-4e88-be47-ccce821d56d8 req-928c862f-580c-413b-a6f2-de1bff491b34 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating instance_info_cache with network_info: [{"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:09:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3285244-fcf8-4e88-be47-ccce821d56d8 req-928c862f-580c-413b-a6f2-de1bff491b34 service nova] Releasing lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:09:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Successfully created port: ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:10:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166201.8574464, 3fa19b27-7628-44ce-b0ae-e1e870337855 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:01 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] VM Resumed (Lifecycle Event)
Aug 16 06:10:01 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Instance spawned successfully.
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166201.857701, 3fa19b27-7628-44ce-b0ae-e1e870337855 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] VM Started (Lifecycle Event)
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Instance spawned successfully.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Took 13.73 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Took 14.36 seconds to build instance.
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Took 19.32 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166202.0403056, 02e364f9-af4e-40bb-a0b4-2b1864f54270 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] VM Resumed (Lifecycle Event)
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-24731225-90b2-4a28-930c-d5bf172924cb tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.489s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance spawned successfully.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166202.040502, 02e364f9-af4e-40bb-a0b4-2b1864f54270 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] VM Started (Lifecycle Event)
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Took 20.12 seconds to build instance.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166202.230962, 70390b89-fdfb-4552-98e5-35568c0268bc => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] VM Resumed (Lifecycle Event)
Aug 16 06:10:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8c315ed-98fd-4c50-a211-c52e1fc6c7ea tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.325s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Took 10.76 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166202.2337801, 70390b89-fdfb-4552-98e5-35568c0268bc => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] VM Started (Lifecycle Event)
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:02 user nova-compute[74681]: INFO nova.compute.manager [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Took 11.41 seconds to build instance.
Aug 16 06:10:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-50d4a5c6-41ab-474c-87b5-a56e7c890175 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.548s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Successfully updated port: cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquired lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-4e1cb22f-a9e7-4c0b-80c0-19c6b65b0f7d req-eb2cc919-3856-45c8-b4ba-cebd10202782 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-changed-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-4e1cb22f-a9e7-4c0b-80c0-19c6b65b0f7d req-eb2cc919-3856-45c8-b4ba-cebd10202782 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Refreshing instance network info cache due to event network-changed-cea7b68d-7124-4c01-94b1-73632f0c4000. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e1cb22f-a9e7-4c0b-80c0-19c6b65b0f7d req-eb2cc919-3856-45c8-b4ba-cebd10202782 service nova] Acquiring lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:10:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Successfully updated port: ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquired lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8cc64c0f-e237-452f-a6dd-852f5f0d4fd9 req-1d0c131a-91f3-4342-aefe-a4d9d3923d3b service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-changed-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8cc64c0f-e237-452f-a6dd-852f5f0d4fd9 req-1d0c131a-91f3-4342-aefe-a4d9d3923d3b service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Refreshing instance network info cache due to event network-changed-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8cc64c0f-e237-452f-a6dd-852f5f0d4fd9 req-1d0c131a-91f3-4342-aefe-a4d9d3923d3b service nova] Acquiring lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Releasing lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance network_info: |[{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e1cb22f-a9e7-4c0b-80c0-19c6b65b0f7d req-eb2cc919-3856-45c8-b4ba-cebd10202782 service nova] Acquired lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.neutron [req-4e1cb22f-a9e7-4c0b-80c0-19c6b65b0f7d req-eb2cc919-3856-45c8-b4ba-cebd10202782 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Refreshing network info cache for port cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Start _get_guest_xml network_info=[{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:10:07 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:07 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1131256241',display_name='tempest-ServerStableDeviceRescueTest-server-1131256241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1131256241',id=4,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA5jr45P5sA8Q8jIF9YaPdfYu6PFHw4mwN8Wy/fnGh6GDyiFgbzHKdR3/VtJ5ZTpACv7rDzpNHLN7chunwDorI6Ro7a1PGSxtD5KWhK23AMyEgusmEgj7VTlSIETlWMsA==',key_name='tempest-keypair-1619526100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc2558af74dc4c419b153219d7149dd7',ramdisk_id='',reservation_id='r-6im7okhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1481713468',owner_user_name='tempest-ServerStableDeviceRescueTest-1481713468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b24840d59e14692a62430236835c592',uuid=d7bc97ea-3b81-488c-8c63-b83a351118d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Converting VIF {"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:69:e0,bridge_name='br-int',has_traffic_filtering=True,id=cea7b68d-7124-4c01-94b1-73632f0c4000,network=Network(87a2a009-9d19-43e6-aa94-a6dd1d7f5764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7b68d-71') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'pci_devices' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:10:07 user nova-compute[74681]:   <uuid>d7bc97ea-3b81-488c-8c63-b83a351118d2</uuid>
Aug 16 06:10:07 user nova-compute[74681]:   <name>instance-00000004</name>
Aug 16 06:10:07 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:10:07 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:10:07 user nova-compute[74681]:   <metadata>
Aug 16 06:10:07 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:10:07 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:10:07 user nova-compute[74681]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1131256241</nova:name>
Aug 16 06:10:07 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:10:07</nova:creationTime>
Aug 16 06:10:07 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:10:07 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:10:07 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:10:07 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:10:07 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:10:07 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:10:07 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:10:07 user nova-compute[74681]:       <nova:owner>
Aug 16 06:10:07 user nova-compute[74681]:         <nova:user uuid="4b24840d59e14692a62430236835c592">tempest-ServerStableDeviceRescueTest-1481713468-project-member</nova:user>
Aug 16 06:10:07 user nova-compute[74681]:         <nova:project uuid="dc2558af74dc4c419b153219d7149dd7">tempest-ServerStableDeviceRescueTest-1481713468</nova:project>
Aug 16 06:10:07 user nova-compute[74681]:       </nova:owner>
Aug 16 06:10:07 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:10:07 user nova-compute[74681]:       <nova:ports>
Aug 16 06:10:07 user nova-compute[74681]:         <nova:port uuid="cea7b68d-7124-4c01-94b1-73632f0c4000">
Aug 16 06:10:07 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 06:10:07 user nova-compute[74681]:         </nova:port>
Aug 16 06:10:07 user nova-compute[74681]:       </nova:ports>
Aug 16 06:10:07 user nova-compute[74681]:     </nova:instance>
Aug 16 06:10:07 user nova-compute[74681]:   </metadata>
Aug 16 06:10:07 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:10:07 user nova-compute[74681]:     <system>
Aug 16 06:10:07 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:10:07 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:10:07 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:10:07 user nova-compute[74681]:       <entry name="serial">d7bc97ea-3b81-488c-8c63-b83a351118d2</entry>
Aug 16 06:10:07 user nova-compute[74681]:       <entry name="uuid">d7bc97ea-3b81-488c-8c63-b83a351118d2</entry>
Aug 16 06:10:07 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:10:07 user nova-compute[74681]:     </system>
Aug 16 06:10:07 user nova-compute[74681]:   </sysinfo>
Aug 16 06:10:07 user nova-compute[74681]:   <os>
Aug 16 06:10:07 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:10:07 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:10:07 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:10:07 user nova-compute[74681]:   </os>
Aug 16 06:10:07 user nova-compute[74681]:   <features>
Aug 16 06:10:07 user nova-compute[74681]:     <acpi/>
Aug 16 06:10:07 user nova-compute[74681]:     <apic/>
Aug 16 06:10:07 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:10:07 user nova-compute[74681]:   </features>
Aug 16 06:10:07 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:10:07 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:10:07 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:10:07 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:10:07 user nova-compute[74681]:   </clock>
Aug 16 06:10:07 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:10:07 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:10:07 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:10:07 user nova-compute[74681]:   </cpu>
Aug 16 06:10:07 user nova-compute[74681]:   <devices>
Aug 16 06:10:07 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:10:07 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:10:07 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk"/>
Aug 16 06:10:07 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:10:07 user nova-compute[74681]:     </disk>
Aug 16 06:10:07 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:10:07 user nova-compute[74681]:       <mac address="fa:16:3e:b1:69:e0"/>
Aug 16 06:10:07 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:07 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:10:07 user nova-compute[74681]:       <target dev="tapcea7b68d-71"/>
Aug 16 06:10:07 user nova-compute[74681]:     </interface>
Aug 16 06:10:07 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:10:07 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/console.log" append="off"/>
Aug 16 06:10:07 user nova-compute[74681]:     </serial>
Aug 16 06:10:07 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:10:07 user nova-compute[74681]:     <video>
Aug 16 06:10:07 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:07 user nova-compute[74681]:     </video>
Aug 16 06:10:07 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:10:07 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:10:07 user nova-compute[74681]:     </rng>
Aug 16 06:10:07 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:10:07 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:10:07 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:10:07 user nova-compute[74681]:     </memballoon>
Aug 16 06:10:07 user nova-compute[74681]:   </devices>
Aug 16 06:10:07 user nova-compute[74681]: </domain>
Aug 16 06:10:07 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1131256241',display_name='tempest-ServerStableDeviceRescueTest-server-1131256241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1131256241',id=4,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA5jr45P5sA8Q8jIF9YaPdfYu6PFHw4mwN8Wy/fnGh6GDyiFgbzHKdR3/VtJ5ZTpACv7rDzpNHLN7chunwDorI6Ro7a1PGSxtD5KWhK23AMyEgusmEgj7VTlSIETlWMsA==',key_name='tempest-keypair-1619526100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc2558af74dc4c419b153219d7149dd7',ramdisk_id='',reservation_id='r-6im7okhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1481713468',owner_user_name='tempest-ServerStableDeviceRescueTest-1481713468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b24840d59e14692a62430236835c592',uuid=d7bc97ea-3b81-488c-8c63-b83a351118d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Converting VIF {"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:69:e0,bridge_name='br-int',has_traffic_filtering=True,id=cea7b68d-7124-4c01-94b1-73632f0c4000,network=Network(87a2a009-9d19-43e6-aa94-a6dd1d7f5764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7b68d-71') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG os_vif [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:69:e0,bridge_name='br-int',has_traffic_filtering=True,id=cea7b68d-7124-4c01-94b1-73632f0c4000,network=Network(87a2a009-9d19-43e6-aa94-a6dd1d7f5764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7b68d-71') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcea7b68d-71, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcea7b68d-71, col_values=(('external_ids', {'iface-id': 'cea7b68d-7124-4c01-94b1-73632f0c4000', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:69:e0', 'vm-uuid': 'd7bc97ea-3b81-488c-8c63-b83a351118d2'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:07 user nova-compute[74681]: INFO os_vif [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:69:e0,bridge_name='br-int',has_traffic_filtering=True,id=cea7b68d-7124-4c01-94b1-73632f0c4000,network=Network(87a2a009-9d19-43e6-aa94-a6dd1d7f5764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7b68d-71')
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No VIF found with MAC fa:16:3e:b1:69:e0, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:10:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Releasing lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance network_info: |[{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8cc64c0f-e237-452f-a6dd-852f5f0d4fd9 req-1d0c131a-91f3-4342-aefe-a4d9d3923d3b service nova] Acquired lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-8cc64c0f-e237-452f-a6dd-852f5f0d4fd9 req-1d0c131a-91f3-4342-aefe-a4d9d3923d3b service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Refreshing network info cache for port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Start _get_guest_xml network_info=[{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:10:09 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:09 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:10:09 user nova-compute[74681]: INFO nova.compute.claims [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Claim successful on node user
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1357676255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1357676255',id=5,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPP4WdnC3IitpPuXRh9DuNwOaenN+tFxMoPwQ4Jrt+KrAEDKAfk0EqNOL7twax4UQxFQ8J959+AlJCZYRuXMxHriC3b+6QPfAM5Prrzgi7p+Y1iarKTje/zmsuBCucm7aQ==',key_name='tempest-keypair-1915031990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-uaxulgsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=90188af1-901c-453f-b113-133b1e86bc85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'pci_devices' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:10:09 user nova-compute[74681]:   <uuid>90188af1-901c-453f-b113-133b1e86bc85</uuid>
Aug 16 06:10:09 user nova-compute[74681]:   <name>instance-00000005</name>
Aug 16 06:10:09 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:10:09 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:10:09 user nova-compute[74681]:   <metadata>
Aug 16 06:10:09 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:10:09 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:10:09 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1357676255</nova:name>
Aug 16 06:10:09 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:10:09</nova:creationTime>
Aug 16 06:10:09 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:10:09 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:10:09 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:10:09 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:10:09 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:10:09 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:10:09 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:10:09 user nova-compute[74681]:       <nova:owner>
Aug 16 06:10:09 user nova-compute[74681]:         <nova:user uuid="2e9ea2042eae46618172633ecf40bb62">tempest-AttachVolumeShelveTestJSON-1422435949-project-member</nova:user>
Aug 16 06:10:09 user nova-compute[74681]:         <nova:project uuid="f7ed7ef3df024e178e16f79008239e48">tempest-AttachVolumeShelveTestJSON-1422435949</nova:project>
Aug 16 06:10:09 user nova-compute[74681]:       </nova:owner>
Aug 16 06:10:09 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:10:09 user nova-compute[74681]:       <nova:ports>
Aug 16 06:10:09 user nova-compute[74681]:         <nova:port uuid="ca0bdeea-d3c9-4993-b9ee-a51a9dd66482">
Aug 16 06:10:09 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 06:10:09 user nova-compute[74681]:         </nova:port>
Aug 16 06:10:09 user nova-compute[74681]:       </nova:ports>
Aug 16 06:10:09 user nova-compute[74681]:     </nova:instance>
Aug 16 06:10:09 user nova-compute[74681]:   </metadata>
Aug 16 06:10:09 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:10:09 user nova-compute[74681]:     <system>
Aug 16 06:10:09 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:10:09 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:10:09 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:10:09 user nova-compute[74681]:       <entry name="serial">90188af1-901c-453f-b113-133b1e86bc85</entry>
Aug 16 06:10:09 user nova-compute[74681]:       <entry name="uuid">90188af1-901c-453f-b113-133b1e86bc85</entry>
Aug 16 06:10:09 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:10:09 user nova-compute[74681]:     </system>
Aug 16 06:10:09 user nova-compute[74681]:   </sysinfo>
Aug 16 06:10:09 user nova-compute[74681]:   <os>
Aug 16 06:10:09 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:10:09 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:10:09 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:10:09 user nova-compute[74681]:   </os>
Aug 16 06:10:09 user nova-compute[74681]:   <features>
Aug 16 06:10:09 user nova-compute[74681]:     <acpi/>
Aug 16 06:10:09 user nova-compute[74681]:     <apic/>
Aug 16 06:10:09 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:10:09 user nova-compute[74681]:   </features>
Aug 16 06:10:09 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:10:09 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:10:09 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:10:09 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:10:09 user nova-compute[74681]:   </clock>
Aug 16 06:10:09 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:10:09 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:10:09 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:10:09 user nova-compute[74681]:   </cpu>
Aug 16 06:10:09 user nova-compute[74681]:   <devices>
Aug 16 06:10:09 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:10:09 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:10:09 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk"/>
Aug 16 06:10:09 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:10:09 user nova-compute[74681]:     </disk>
Aug 16 06:10:09 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:10:09 user nova-compute[74681]:       <mac address="fa:16:3e:df:86:ff"/>
Aug 16 06:10:09 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:09 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:10:09 user nova-compute[74681]:       <target dev="tapca0bdeea-d3"/>
Aug 16 06:10:09 user nova-compute[74681]:     </interface>
Aug 16 06:10:09 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:10:09 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/console.log" append="off"/>
Aug 16 06:10:09 user nova-compute[74681]:     </serial>
Aug 16 06:10:09 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:10:09 user nova-compute[74681]:     <video>
Aug 16 06:10:09 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:09 user nova-compute[74681]:     </video>
Aug 16 06:10:09 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:10:09 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:10:09 user nova-compute[74681]:     </rng>
Aug 16 06:10:09 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:10:09 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:10:09 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:10:09 user nova-compute[74681]:     </memballoon>
Aug 16 06:10:09 user nova-compute[74681]:   </devices>
Aug 16 06:10:09 user nova-compute[74681]: </domain>
Aug 16 06:10:09 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1357676255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1357676255',id=5,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPP4WdnC3IitpPuXRh9DuNwOaenN+tFxMoPwQ4Jrt+KrAEDKAfk0EqNOL7twax4UQxFQ8J959+AlJCZYRuXMxHriC3b+6QPfAM5Prrzgi7p+Y1iarKTje/zmsuBCucm7aQ==',key_name='tempest-keypair-1915031990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-uaxulgsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:09:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=90188af1-901c-453f-b113-133b1e86bc85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG os_vif [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca0bdeea-d3, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca0bdeea-d3, col_values=(('external_ids', {'iface-id': 'ca0bdeea-d3c9-4993-b9ee-a51a9dd66482', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:86:ff', 'vm-uuid': '90188af1-901c-453f-b113-133b1e86bc85'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:10:09 user nova-compute[74681]: INFO os_vif [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3')
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No VIF found with MAC fa:16:3e:df:86:ff, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:10:09 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:10:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:10:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:10:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Creating image(s)
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "/opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "/opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG nova.policy [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd15ba1a73e62426c97713c02fd1c31fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c36ac064a14486eb8673f39338119db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.294s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.network.neutron [req-4e1cb22f-a9e7-4c0b-80c0-19c6b65b0f7d req-eb2cc919-3856-45c8-b4ba-cebd10202782 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updated VIF entry in instance network info cache for port cea7b68d-7124-4c01-94b1-73632f0c4000. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.network.neutron [req-4e1cb22f-a9e7-4c0b-80c0-19c6b65b0f7d req-eb2cc919-3856-45c8-b4ba-cebd10202782 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e1cb22f-a9e7-4c0b-80c0-19c6b65b0f7d req-eb2cc919-3856-45c8-b4ba-cebd10202782 service nova] Releasing lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.240s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk 1073741824" returned: 0 in 0.071s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.196s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Cannot resize image /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'migration_context' on Instance uuid 6fa74c3d-f621-4cf2-8763-6d75109fb113 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.network.neutron [req-8cc64c0f-e237-452f-a6dd-852f5f0d4fd9 req-1d0c131a-91f3-4342-aefe-a4d9d3923d3b service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updated VIF entry in instance network info cache for port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.network.neutron [req-8cc64c0f-e237-452f-a6dd-852f5f0d4fd9 req-1d0c131a-91f3-4342-aefe-a4d9d3923d3b service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Ensure instance console log exists: /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8cc64c0f-e237-452f-a6dd-852f5f0d4fd9 req-1d0c131a-91f3-4342-aefe-a4d9d3923d3b service nova] Releasing lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:13 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Successfully created port: 48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:10:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:13 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166213.970409, d7bc97ea-3b81-488c-8c63-b83a351118d2 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:13 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] VM Resumed (Lifecycle Event)
Aug 16 06:10:13 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance spawned successfully.
Aug 16 06:10:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:14 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166213.970655, d7bc97ea-3b81-488c-8c63-b83a351118d2 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:14 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] VM Started (Lifecycle Event)
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:14 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:14 user nova-compute[74681]: INFO nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Took 18.87 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:14 user nova-compute[74681]: INFO nova.compute.manager [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Took 20.01 seconds to build instance.
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Successfully updated port: 48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7fe2d859-5cf9-4819-9f45-5cf82b9f972b tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.260s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquired lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-79684e92-3ee4-4e4d-9422-5e225d2afed1 req-51266d53-aefe-4e53-829a-c24839e18548 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received event network-changed-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-79684e92-3ee4-4e4d-9422-5e225d2afed1 req-51266d53-aefe-4e53-829a-c24839e18548 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Refreshing instance network info cache due to event network-changed-48ca2fee-705e-4726-8b71-1ddd30f158d4. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-79684e92-3ee4-4e4d-9422-5e225d2afed1 req-51266d53-aefe-4e53-829a-c24839e18548 service nova] Acquiring lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:14 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updating instance_info_cache with network_info: [{"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Releasing lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Instance network_info: |[{"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-79684e92-3ee4-4e4d-9422-5e225d2afed1 req-51266d53-aefe-4e53-829a-c24839e18548 service nova] Acquired lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.network.neutron [req-79684e92-3ee4-4e4d-9422-5e225d2afed1 req-51266d53-aefe-4e53-829a-c24839e18548 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Refreshing network info cache for port 48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Start _get_guest_xml network_info=[{"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:10:15 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:15 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-483510836',display_name='tempest-VolumesAdminNegativeTest-server-483510836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-483510836',id=6,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWKHYeWD7ESUmPMiUorXCULKHUwW1JFLpVh0ViOl9d1WOcz4V34a47c7LhRxvoi37qq0PVTiQkBzfAxI1PkZmMcBbqLpt/q9JP4r8UGlFJDbt6214Fk7aq3tAzhaK/Adw==',key_name='tempest-keypair-1459112770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c36ac064a14486eb8673f39338119db',ramdisk_id='',reservation_id='r-9dy2umhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-128005769',owner_user_name='tempest-VolumesAdminNegativeTest-128005769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d15ba1a73e62426c97713c02fd1c31fb',uuid=6fa74c3d-f621-4cf2-8763-6d75109fb113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converting VIF {"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:7a:64,bridge_name='br-int',has_traffic_filtering=True,id=48ca2fee-705e-4726-8b71-1ddd30f158d4,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ca2fee-70') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fa74c3d-f621-4cf2-8763-6d75109fb113 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:10:15 user nova-compute[74681]:   <uuid>6fa74c3d-f621-4cf2-8763-6d75109fb113</uuid>
Aug 16 06:10:15 user nova-compute[74681]:   <name>instance-00000006</name>
Aug 16 06:10:15 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:10:15 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:10:15 user nova-compute[74681]:   <metadata>
Aug 16 06:10:15 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:10:15 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:10:15 user nova-compute[74681]:       <nova:name>tempest-VolumesAdminNegativeTest-server-483510836</nova:name>
Aug 16 06:10:15 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:10:15</nova:creationTime>
Aug 16 06:10:15 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:10:15 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:10:15 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:10:15 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:10:15 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:10:15 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:10:15 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:10:15 user nova-compute[74681]:       <nova:owner>
Aug 16 06:10:15 user nova-compute[74681]:         <nova:user uuid="d15ba1a73e62426c97713c02fd1c31fb">tempest-VolumesAdminNegativeTest-128005769-project-member</nova:user>
Aug 16 06:10:15 user nova-compute[74681]:         <nova:project uuid="5c36ac064a14486eb8673f39338119db">tempest-VolumesAdminNegativeTest-128005769</nova:project>
Aug 16 06:10:15 user nova-compute[74681]:       </nova:owner>
Aug 16 06:10:15 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:10:15 user nova-compute[74681]:       <nova:ports>
Aug 16 06:10:15 user nova-compute[74681]:         <nova:port uuid="48ca2fee-705e-4726-8b71-1ddd30f158d4">
Aug 16 06:10:15 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 06:10:15 user nova-compute[74681]:         </nova:port>
Aug 16 06:10:15 user nova-compute[74681]:       </nova:ports>
Aug 16 06:10:15 user nova-compute[74681]:     </nova:instance>
Aug 16 06:10:15 user nova-compute[74681]:   </metadata>
Aug 16 06:10:15 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:10:15 user nova-compute[74681]:     <system>
Aug 16 06:10:15 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:10:15 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:10:15 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:10:15 user nova-compute[74681]:       <entry name="serial">6fa74c3d-f621-4cf2-8763-6d75109fb113</entry>
Aug 16 06:10:15 user nova-compute[74681]:       <entry name="uuid">6fa74c3d-f621-4cf2-8763-6d75109fb113</entry>
Aug 16 06:10:15 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:10:15 user nova-compute[74681]:     </system>
Aug 16 06:10:15 user nova-compute[74681]:   </sysinfo>
Aug 16 06:10:15 user nova-compute[74681]:   <os>
Aug 16 06:10:15 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:10:15 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:10:15 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:10:15 user nova-compute[74681]:   </os>
Aug 16 06:10:15 user nova-compute[74681]:   <features>
Aug 16 06:10:15 user nova-compute[74681]:     <acpi/>
Aug 16 06:10:15 user nova-compute[74681]:     <apic/>
Aug 16 06:10:15 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:10:15 user nova-compute[74681]:   </features>
Aug 16 06:10:15 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:10:15 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:10:15 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:10:15 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:10:15 user nova-compute[74681]:   </clock>
Aug 16 06:10:15 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:10:15 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:10:15 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:10:15 user nova-compute[74681]:   </cpu>
Aug 16 06:10:15 user nova-compute[74681]:   <devices>
Aug 16 06:10:15 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:10:15 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:10:15 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk"/>
Aug 16 06:10:15 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:10:15 user nova-compute[74681]:     </disk>
Aug 16 06:10:15 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:10:15 user nova-compute[74681]:       <mac address="fa:16:3e:f2:7a:64"/>
Aug 16 06:10:15 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:15 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:10:15 user nova-compute[74681]:       <target dev="tap48ca2fee-70"/>
Aug 16 06:10:15 user nova-compute[74681]:     </interface>
Aug 16 06:10:15 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:10:15 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/console.log" append="off"/>
Aug 16 06:10:15 user nova-compute[74681]:     </serial>
Aug 16 06:10:15 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:10:15 user nova-compute[74681]:     <video>
Aug 16 06:10:15 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:15 user nova-compute[74681]:     </video>
Aug 16 06:10:15 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:10:15 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:10:15 user nova-compute[74681]:     </rng>
Aug 16 06:10:15 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:10:15 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:10:15 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:10:15 user nova-compute[74681]:     </memballoon>
Aug 16 06:10:15 user nova-compute[74681]:   </devices>
Aug 16 06:10:15 user nova-compute[74681]: </domain>
Aug 16 06:10:15 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-483510836',display_name='tempest-VolumesAdminNegativeTest-server-483510836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-483510836',id=6,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWKHYeWD7ESUmPMiUorXCULKHUwW1JFLpVh0ViOl9d1WOcz4V34a47c7LhRxvoi37qq0PVTiQkBzfAxI1PkZmMcBbqLpt/q9JP4r8UGlFJDbt6214Fk7aq3tAzhaK/Adw==',key_name='tempest-keypair-1459112770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c36ac064a14486eb8673f39338119db',ramdisk_id='',reservation_id='r-9dy2umhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-128005769',owner_user_name='tempest-VolumesAdminNegativeTest-128005769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d15ba1a73e62426c97713c02fd1c31fb',uuid=6fa74c3d-f621-4cf2-8763-6d75109fb113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converting VIF {"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:7a:64,bridge_name='br-int',has_traffic_filtering=True,id=48ca2fee-705e-4726-8b71-1ddd30f158d4,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ca2fee-70') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG os_vif [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:7a:64,bridge_name='br-int',has_traffic_filtering=True,id=48ca2fee-705e-4726-8b71-1ddd30f158d4,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ca2fee-70') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48ca2fee-70, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48ca2fee-70, col_values=(('external_ids', {'iface-id': '48ca2fee-705e-4726-8b71-1ddd30f158d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:7a:64', 'vm-uuid': '6fa74c3d-f621-4cf2-8763-6d75109fb113'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:15 user nova-compute[74681]: INFO os_vif [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:7a:64,bridge_name='br-int',has_traffic_filtering=True,id=48ca2fee-705e-4726-8b71-1ddd30f158d4,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ca2fee-70')
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166215.627807, 90188af1-901c-453f-b113-133b1e86bc85 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:15 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] VM Resumed (Lifecycle Event)
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance spawned successfully.
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:15 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166215.6280062, 90188af1-901c-453f-b113-133b1e86bc85 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:15 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] VM Started (Lifecycle Event)
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] No VIF found with MAC fa:16:3e:f2:7a:64, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:10:15 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:15 user nova-compute[74681]: INFO nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Took 19.93 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:16 user nova-compute[74681]: INFO nova.compute.manager [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Took 21.07 seconds to build instance.
Aug 16 06:10:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0f6cd463-e8f9-4ae1-99d0-f50e6b582011 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.344s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-79684e92-3ee4-4e4d-9422-5e225d2afed1 req-51266d53-aefe-4e53-829a-c24839e18548 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updated VIF entry in instance network info cache for port 48ca2fee-705e-4726-8b71-1ddd30f158d4. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:10:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-79684e92-3ee4-4e4d-9422-5e225d2afed1 req-51266d53-aefe-4e53-829a-c24839e18548 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updating instance_info_cache with network_info: [{"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-79684e92-3ee4-4e4d-9422-5e225d2afed1 req-51266d53-aefe-4e53-829a-c24839e18548 service nova] Releasing lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-9896f39e-599b-46b1-8b7c-dc6c07b2d9d7 req-1cecd8bb-5fe7-4e3d-9416-b965436833dc service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9896f39e-599b-46b1-8b7c-dc6c07b2d9d7 req-1cecd8bb-5fe7-4e3d-9416-b965436833dc service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9896f39e-599b-46b1-8b7c-dc6c07b2d9d7 req-1cecd8bb-5fe7-4e3d-9416-b965436833dc service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9896f39e-599b-46b1-8b7c-dc6c07b2d9d7 req-1cecd8bb-5fe7-4e3d-9416-b965436833dc service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-9896f39e-599b-46b1-8b7c-dc6c07b2d9d7 req-1cecd8bb-5fe7-4e3d-9416-b965436833dc service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:19 user nova-compute[74681]: WARNING nova.compute.manager [req-9896f39e-599b-46b1-8b7c-dc6c07b2d9d7 req-1cecd8bb-5fe7-4e3d-9416-b965436833dc service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state active and task_state None.
Aug 16 06:10:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:10:20 user nova-compute[74681]: INFO nova.compute.claims [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Claim successful on node user
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166220.874602, 6fa74c3d-f621-4cf2-8763-6d75109fb113 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:20 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] VM Resumed (Lifecycle Event)
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:20 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Instance spawned successfully.
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:20 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:20 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166220.874874, 6fa74c3d-f621-4cf2-8763-6d75109fb113 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:20 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] VM Started (Lifecycle Event)
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:21 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:21 user nova-compute[74681]: INFO nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Took 10.60 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:21 user nova-compute[74681]: INFO nova.compute.manager [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Took 11.96 seconds to build instance.
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b2d93d4b-e591-4cf5-a21c-e44904e36b56 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.092s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.765s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-8819a8fa-975e-4c47-ba41-3d164c49ad1d req-a4ea9159-867e-4803-9815-667cc71f6561 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8819a8fa-975e-4c47-ba41-3d164c49ad1d req-a4ea9159-867e-4803-9815-667cc71f6561 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8819a8fa-975e-4c47-ba41-3d164c49ad1d req-a4ea9159-867e-4803-9815-667cc71f6561 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8819a8fa-975e-4c47-ba41-3d164c49ad1d req-a4ea9159-867e-4803-9815-667cc71f6561 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-8819a8fa-975e-4c47-ba41-3d164c49ad1d req-a4ea9159-867e-4803-9815-667cc71f6561 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:21 user nova-compute[74681]: WARNING nova.compute.manager [req-8819a8fa-975e-4c47-ba41-3d164c49ad1d req-a4ea9159-867e-4803-9815-667cc71f6561 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state active and task_state None.
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:10:21 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.policy [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9edd2fb688ff4a44b33af0ae3a358f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a954b5814d46929acbbfbc993c73a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:10:21 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Creating image(s)
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.254s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:10:22 user nova-compute[74681]: INFO nova.compute.claims [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Claim successful on node user
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.220s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk 1073741824" returned: 0 in 0.066s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.229s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Cannot resize image /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.objects.instance [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'migration_context' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Ensure instance console log exists: /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.546s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:10:22 user nova-compute[74681]: INFO nova.compute.claims [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Claim successful on node user
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:10:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:10:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 06:10:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG nova.policy [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbdcd8eb87804ba58d03751da01af759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34edee75771d4c0993fe85fb7d542866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:10:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Creating image(s)
Aug 16 06:10:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "/opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "/opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "/opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "1fda689a38e5d0576199e5f505e64cac91438bbf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "1fda689a38e5d0576199e5f505e64cac91438bbf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG nova.network.neutron [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Successfully created port: 3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf.part --force-share --output=json" returned: 0 in 0.206s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG nova.virt.images [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] 9988e973-8837-492a-a4fc-bb1e8a7eec51 was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:10:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf.part /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.411s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf.part /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf.converted" returned: 0 in 0.389s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:10:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "1fda689a38e5d0576199e5f505e64cac91438bbf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.294s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:10:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Creating image(s)
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "/opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "/opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "/opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG nova.policy [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0ca9b1734834832b7eebf4fd4219a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a54d0ad3b1e45a6acc243906b2483c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf --force-share --output=json" returned: 0 in 0.197s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "1fda689a38e5d0576199e5f505e64cac91438bbf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "1fda689a38e5d0576199e5f505e64cac91438bbf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.206s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf --force-share --output=json" returned: 0 in 0.229s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf,backing_fmt=raw /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Successfully created port: c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Successfully updated port: 3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf,backing_fmt=raw /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk 1073741824" returned: 0 in 0.072s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquired lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "1fda689a38e5d0576199e5f505e64cac91438bbf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-68530ee1-2124-42b2-acb9-b3c9cf703a1b req-33b07dde-96b0-493d-9c02-3072da7af2bf service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-changed-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-68530ee1-2124-42b2-acb9-b3c9cf703a1b req-33b07dde-96b0-493d-9c02-3072da7af2bf service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Refreshing instance network info cache due to event network-changed-3627db91-9415-4563-b459-d2b461b3c470. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68530ee1-2124-42b2-acb9-b3c9cf703a1b req-33b07dde-96b0-493d-9c02-3072da7af2bf service nova] Acquiring lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.330s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk 1073741824" returned: 0 in 0.108s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.448s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf --force-share --output=json" returned: 0 in 0.286s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.227s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Cannot resize image /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lazy-loading 'migration_context' on Instance uuid 903e763a-6ec7-415a-8db9-c5330cd93aec {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:10:25 user nova-compute[74681]: INFO nova.compute.claims [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Claim successful on node user
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Ensure instance console log exists: /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.400s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Cannot resize image /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lazy-loading 'migration_context' on Instance uuid 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Releasing lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Instance network_info: |[{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68530ee1-2124-42b2-acb9-b3c9cf703a1b req-33b07dde-96b0-493d-9c02-3072da7af2bf service nova] Acquired lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.network.neutron [req-68530ee1-2124-42b2-acb9-b3c9cf703a1b req-33b07dde-96b0-493d-9c02-3072da7af2bf service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Refreshing network info cache for port 3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Start _get_guest_xml network_info=[{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:10:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Ensure instance console log exists: /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:26 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:26 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converting VIF {"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d3:83,bridge_name='br-int',has_traffic_filtering=True,id=3627db91-9415-4563-b459-d2b461b3c470,network=Network(7697659e-f313-4a47-8a93-bc3a1b5d39a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3627db91-94') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.objects.instance [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'pci_devices' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Successfully created port: f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:10:26 user nova-compute[74681]:   <uuid>76acb01b-43fd-4a5b-990d-ee95e09aeeab</uuid>
Aug 16 06:10:26 user nova-compute[74681]:   <name>instance-00000007</name>
Aug 16 06:10:26 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:10:26 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:10:26 user nova-compute[74681]:   <metadata>
Aug 16 06:10:26 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:10:26 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:10:26 user nova-compute[74681]:       <nova:name>tempest-device-tagging-server-1139632821</nova:name>
Aug 16 06:10:26 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:10:26</nova:creationTime>
Aug 16 06:10:26 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:10:26 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:10:26 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:10:26 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:10:26 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:10:26 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:10:26 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:10:26 user nova-compute[74681]:       <nova:owner>
Aug 16 06:10:26 user nova-compute[74681]:         <nova:user uuid="9edd2fb688ff4a44b33af0ae3a358f53">tempest-TaggedAttachmentsTest-1137660729-project-member</nova:user>
Aug 16 06:10:26 user nova-compute[74681]:         <nova:project uuid="85a954b5814d46929acbbfbc993c73a3">tempest-TaggedAttachmentsTest-1137660729</nova:project>
Aug 16 06:10:26 user nova-compute[74681]:       </nova:owner>
Aug 16 06:10:26 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:10:26 user nova-compute[74681]:       <nova:ports>
Aug 16 06:10:26 user nova-compute[74681]:         <nova:port uuid="3627db91-9415-4563-b459-d2b461b3c470">
Aug 16 06:10:26 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:10:26 user nova-compute[74681]:         </nova:port>
Aug 16 06:10:26 user nova-compute[74681]:       </nova:ports>
Aug 16 06:10:26 user nova-compute[74681]:     </nova:instance>
Aug 16 06:10:26 user nova-compute[74681]:   </metadata>
Aug 16 06:10:26 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:10:26 user nova-compute[74681]:     <system>
Aug 16 06:10:26 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:10:26 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:10:26 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:10:26 user nova-compute[74681]:       <entry name="serial">76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:10:26 user nova-compute[74681]:       <entry name="uuid">76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:10:26 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:10:26 user nova-compute[74681]:     </system>
Aug 16 06:10:26 user nova-compute[74681]:   </sysinfo>
Aug 16 06:10:26 user nova-compute[74681]:   <os>
Aug 16 06:10:26 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:10:26 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:10:26 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:10:26 user nova-compute[74681]:   </os>
Aug 16 06:10:26 user nova-compute[74681]:   <features>
Aug 16 06:10:26 user nova-compute[74681]:     <acpi/>
Aug 16 06:10:26 user nova-compute[74681]:     <apic/>
Aug 16 06:10:26 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:10:26 user nova-compute[74681]:   </features>
Aug 16 06:10:26 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:10:26 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:10:26 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:10:26 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:10:26 user nova-compute[74681]:   </clock>
Aug 16 06:10:26 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:10:26 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:10:26 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:10:26 user nova-compute[74681]:   </cpu>
Aug 16 06:10:26 user nova-compute[74681]:   <devices>
Aug 16 06:10:26 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:10:26 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:10:26 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk"/>
Aug 16 06:10:26 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:10:26 user nova-compute[74681]:     </disk>
Aug 16 06:10:26 user nova-compute[74681]:     <disk type="file" device="cdrom">
Aug 16 06:10:26 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 06:10:26 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.config"/>
Aug 16 06:10:26 user nova-compute[74681]:       <target dev="hda" bus="ide"/>
Aug 16 06:10:26 user nova-compute[74681]:     </disk>
Aug 16 06:10:26 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:10:26 user nova-compute[74681]:       <mac address="fa:16:3e:b1:d3:83"/>
Aug 16 06:10:26 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:26 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:10:26 user nova-compute[74681]:       <target dev="tap3627db91-94"/>
Aug 16 06:10:26 user nova-compute[74681]:     </interface>
Aug 16 06:10:26 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:10:26 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log" append="off"/>
Aug 16 06:10:26 user nova-compute[74681]:     </serial>
Aug 16 06:10:26 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:10:26 user nova-compute[74681]:     <video>
Aug 16 06:10:26 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:26 user nova-compute[74681]:     </video>
Aug 16 06:10:26 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:10:26 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:10:26 user nova-compute[74681]:     </rng>
Aug 16 06:10:26 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:10:26 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:10:26 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:10:26 user nova-compute[74681]:     </memballoon>
Aug 16 06:10:26 user nova-compute[74681]:   </devices>
Aug 16 06:10:26 user nova-compute[74681]: </domain>
Aug 16 06:10:26 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converting VIF {"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d3:83,bridge_name='br-int',has_traffic_filtering=True,id=3627db91-9415-4563-b459-d2b461b3c470,network=Network(7697659e-f313-4a47-8a93-bc3a1b5d39a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3627db91-94') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG os_vif [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d3:83,bridge_name='br-int',has_traffic_filtering=True,id=3627db91-9415-4563-b459-d2b461b3c470,network=Network(7697659e-f313-4a47-8a93-bc3a1b5d39a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3627db91-94') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3627db91-94, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3627db91-94, col_values=(('external_ids', {'iface-id': '3627db91-9415-4563-b459-d2b461b3c470', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:d3:83', 'vm-uuid': '76acb01b-43fd-4a5b-990d-ee95e09aeeab'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:26 user nova-compute[74681]: INFO os_vif [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d3:83,bridge_name='br-int',has_traffic_filtering=True,id=3627db91-9415-4563-b459-d2b461b3c470,network=Network(7697659e-f313-4a47-8a93-bc3a1b5d39a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3627db91-94')
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No BDM found with device name hda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No VIF found with MAC fa:16:3e:b1:d3:83, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:10:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Using config drive
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.057s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:10:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Creating config drive at /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.config
Aug 16 06:10:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprwnkb1cx {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprwnkb1cx" returned: 0 in 0.094s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:10:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:10:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-68530ee1-2124-42b2-acb9-b3c9cf703a1b req-33b07dde-96b0-493d-9c02-3072da7af2bf service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updated VIF entry in instance network info cache for port 3627db91-9415-4563-b459-d2b461b3c470. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-68530ee1-2124-42b2-acb9-b3c9cf703a1b req-33b07dde-96b0-493d-9c02-3072da7af2bf service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Successfully updated port: c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68530ee1-2124-42b2-acb9-b3c9cf703a1b req-33b07dde-96b0-493d-9c02-3072da7af2bf service nova] Releasing lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquired lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-e7fe854c-75b2-4012-a183-2a425ddafa39 req-8272041b-9b9f-4094-99a1-3cc423aed736 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received event network-changed-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-e7fe854c-75b2-4012-a183-2a425ddafa39 req-8272041b-9b9f-4094-99a1-3cc423aed736 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Refreshing instance network info cache due to event network-changed-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e7fe854c-75b2-4012-a183-2a425ddafa39 req-8272041b-9b9f-4094-99a1-3cc423aed736 service nova] Acquiring lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.policy [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '786261495dab40028aba9ec701354abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b9899e5b2c4c208197b432e42dff8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:10:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Creating image(s)
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "/opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "/opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.262s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Updating instance_info_cache with network_info: [{"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.268s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Releasing lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Instance network_info: |[{"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e7fe854c-75b2-4012-a183-2a425ddafa39 req-8272041b-9b9f-4094-99a1-3cc423aed736 service nova] Acquired lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-e7fe854c-75b2-4012-a183-2a425ddafa39 req-8272041b-9b9f-4094-99a1-3cc423aed736 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Refreshing network info cache for port c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Start _get_guest_xml network_info=[{"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:10:10Z,direct_url=<?>,disk_format='qcow2',id=9988e973-8837-492a-a4fc-bb1e8a7eec51,min_disk=0,min_ram=0,name='',owner='ab277832c3674340b0c3beed3565d239',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:10:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'scsi', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'image_id': '9988e973-8837-492a-a4fc-bb1e8a7eec51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk 1073741824" returned: 0 in 0.092s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:27 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:27 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:10:10Z,direct_url=<?>,disk_format='qcow2',id=9988e973-8837-492a-a4fc-bb1e8a7eec51,min_disk=0,min_ram=0,name='',owner='ab277832c3674340b0c3beed3565d239',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:10:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-267106615',display_name='tempest-AttachSCSIVolumeTestJSON-server-267106615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-267106615',id=8,image_ref='9988e973-8837-492a-a4fc-bb1e8a7eec51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK++Aw4Bmz49jMu/ZGAWPlv+WsbWQhqFPpEbTFM6MLTulR+f3SAsfdnbQ80g0/1yhuDRyTZpBTb37L7lYnRYvMJyU2CUQJdsisFxxFeppGJB/JiPTTeKspg4ip5DH3jwJQ==',key_name='tempest-keypair-298907551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34edee75771d4c0993fe85fb7d542866',ramdisk_id='',reservation_id='r-90s034wl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9988e973-8837-492a-a4fc-bb1e8a7eec51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1294003642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1294003642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdcd8eb87804ba58d03751da01af759',uuid=903e763a-6ec7-415a-8db9-c5330cd93aec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Converting VIF {"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:77:8b,bridge_name='br-int',has_traffic_filtering=True,id=c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d,network=Network(1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fb9ba0-1e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lazy-loading 'pci_devices' on Instance uuid 903e763a-6ec7-415a-8db9-c5330cd93aec {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:10:28 user nova-compute[74681]:   <uuid>903e763a-6ec7-415a-8db9-c5330cd93aec</uuid>
Aug 16 06:10:28 user nova-compute[74681]:   <name>instance-00000008</name>
Aug 16 06:10:28 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:10:28 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:10:28 user nova-compute[74681]:   <metadata>
Aug 16 06:10:28 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:10:28 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:10:28 user nova-compute[74681]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-267106615</nova:name>
Aug 16 06:10:28 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:10:27</nova:creationTime>
Aug 16 06:10:28 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:10:28 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:10:28 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:10:28 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:10:28 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:10:28 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:10:28 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:10:28 user nova-compute[74681]:       <nova:owner>
Aug 16 06:10:28 user nova-compute[74681]:         <nova:user uuid="cbdcd8eb87804ba58d03751da01af759">tempest-AttachSCSIVolumeTestJSON-1294003642-project-member</nova:user>
Aug 16 06:10:28 user nova-compute[74681]:         <nova:project uuid="34edee75771d4c0993fe85fb7d542866">tempest-AttachSCSIVolumeTestJSON-1294003642</nova:project>
Aug 16 06:10:28 user nova-compute[74681]:       </nova:owner>
Aug 16 06:10:28 user nova-compute[74681]:       <nova:root type="image" uuid="9988e973-8837-492a-a4fc-bb1e8a7eec51"/>
Aug 16 06:10:28 user nova-compute[74681]:       <nova:ports>
Aug 16 06:10:28 user nova-compute[74681]:         <nova:port uuid="c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d">
Aug 16 06:10:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 06:10:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:10:28 user nova-compute[74681]:       </nova:ports>
Aug 16 06:10:28 user nova-compute[74681]:     </nova:instance>
Aug 16 06:10:28 user nova-compute[74681]:   </metadata>
Aug 16 06:10:28 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:10:28 user nova-compute[74681]:     <system>
Aug 16 06:10:28 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:10:28 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:10:28 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:10:28 user nova-compute[74681]:       <entry name="serial">903e763a-6ec7-415a-8db9-c5330cd93aec</entry>
Aug 16 06:10:28 user nova-compute[74681]:       <entry name="uuid">903e763a-6ec7-415a-8db9-c5330cd93aec</entry>
Aug 16 06:10:28 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:10:28 user nova-compute[74681]:     </system>
Aug 16 06:10:28 user nova-compute[74681]:   </sysinfo>
Aug 16 06:10:28 user nova-compute[74681]:   <os>
Aug 16 06:10:28 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:10:28 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:10:28 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:10:28 user nova-compute[74681]:   </os>
Aug 16 06:10:28 user nova-compute[74681]:   <features>
Aug 16 06:10:28 user nova-compute[74681]:     <acpi/>
Aug 16 06:10:28 user nova-compute[74681]:     <apic/>
Aug 16 06:10:28 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:10:28 user nova-compute[74681]:   </features>
Aug 16 06:10:28 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:10:28 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:10:28 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:10:28 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:10:28 user nova-compute[74681]:   </clock>
Aug 16 06:10:28 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:10:28 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:10:28 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:10:28 user nova-compute[74681]:   </cpu>
Aug 16 06:10:28 user nova-compute[74681]:   <devices>
Aug 16 06:10:28 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:10:28 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:10:28 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk"/>
Aug 16 06:10:28 user nova-compute[74681]:       <target dev="sda" bus="scsi"/>
Aug 16 06:10:28 user nova-compute[74681]:       <address type="drive" controller="0" unit="0"/>
Aug 16 06:10:28 user nova-compute[74681]:     </disk>
Aug 16 06:10:28 user nova-compute[74681]:     <disk type="file" device="cdrom">
Aug 16 06:10:28 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 06:10:28 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk.config"/>
Aug 16 06:10:28 user nova-compute[74681]:       <target dev="sdb" bus="scsi"/>
Aug 16 06:10:28 user nova-compute[74681]:       <address type="drive" controller="0" unit="1"/>
Aug 16 06:10:28 user nova-compute[74681]:     </disk>
Aug 16 06:10:28 user nova-compute[74681]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 06:10:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:10:28 user nova-compute[74681]:       <mac address="fa:16:3e:7d:77:8b"/>
Aug 16 06:10:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:10:28 user nova-compute[74681]:       <target dev="tapc0fb9ba0-1e"/>
Aug 16 06:10:28 user nova-compute[74681]:     </interface>
Aug 16 06:10:28 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:10:28 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/console.log" append="off"/>
Aug 16 06:10:28 user nova-compute[74681]:     </serial>
Aug 16 06:10:28 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:10:28 user nova-compute[74681]:     <video>
Aug 16 06:10:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:28 user nova-compute[74681]:     </video>
Aug 16 06:10:28 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:10:28 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:10:28 user nova-compute[74681]:     </rng>
Aug 16 06:10:28 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:10:28 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:10:28 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:10:28 user nova-compute[74681]:     </memballoon>
Aug 16 06:10:28 user nova-compute[74681]:   </devices>
Aug 16 06:10:28 user nova-compute[74681]: </domain>
Aug 16 06:10:28 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-267106615',display_name='tempest-AttachSCSIVolumeTestJSON-server-267106615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-267106615',id=8,image_ref='9988e973-8837-492a-a4fc-bb1e8a7eec51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK++Aw4Bmz49jMu/ZGAWPlv+WsbWQhqFPpEbTFM6MLTulR+f3SAsfdnbQ80g0/1yhuDRyTZpBTb37L7lYnRYvMJyU2CUQJdsisFxxFeppGJB/JiPTTeKspg4ip5DH3jwJQ==',key_name='tempest-keypair-298907551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34edee75771d4c0993fe85fb7d542866',ramdisk_id='',reservation_id='r-90s034wl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9988e973-8837-492a-a4fc-bb1e8a7eec51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1294003642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1294003642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdcd8eb87804ba58d03751da01af759',uuid=903e763a-6ec7-415a-8db9-c5330cd93aec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Converting VIF {"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:77:8b,bridge_name='br-int',has_traffic_filtering=True,id=c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d,network=Network(1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fb9ba0-1e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG os_vif [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:77:8b,bridge_name='br-int',has_traffic_filtering=True,id=c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d,network=Network(1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fb9ba0-1e') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0fb9ba0-1e, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0fb9ba0-1e, col_values=(('external_ids', {'iface-id': 'c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:77:8b', 'vm-uuid': '903e763a-6ec7-415a-8db9-c5330cd93aec'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] There are 0 instances to clean {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74681) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:28 user nova-compute[74681]: INFO os_vif [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:77:8b,bridge_name='br-int',has_traffic_filtering=True,id=c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d,network=Network(1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fb9ba0-1e')
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.304s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Successfully updated port: f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Successfully created port: f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquired lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] No BDM found with device name sda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] No VIF found with MAC fa:16:3e:7d:77:8b, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:10:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Using config drive
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Cannot resize image /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.objects.instance [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lazy-loading 'migration_context' on Instance uuid 2f74fd47-e29b-4392-9af3-eabed0d91993 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Ensure instance console log exists: /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Creating config drive at /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk.config
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyshbk2ie {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyshbk2ie" returned: 0 in 0.063s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-193a5493-3ae2-40e9-b0ea-94c4db28a546 req-ed410c33-e7bf-42e7-bc90-b90a88f49429 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received event network-changed-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-193a5493-3ae2-40e9-b0ea-94c4db28a546 req-ed410c33-e7bf-42e7-bc90-b90a88f49429 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Refreshing instance network info cache due to event network-changed-f1a21da6-a59f-430a-8b0b-2d0ed16ac211. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-193a5493-3ae2-40e9-b0ea-94c4db28a546 req-ed410c33-e7bf-42e7-bc90-b90a88f49429 service nova] Acquiring lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-e7fe854c-75b2-4012-a183-2a425ddafa39 req-8272041b-9b9f-4094-99a1-3cc423aed736 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Updated VIF entry in instance network info cache for port c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-e7fe854c-75b2-4012-a183-2a425ddafa39 req-8272041b-9b9f-4094-99a1-3cc423aed736 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Updating instance_info_cache with network_info: [{"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e7fe854c-75b2-4012-a183-2a425ddafa39 req-8272041b-9b9f-4094-99a1-3cc423aed736 service nova] Releasing lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Successfully updated port: f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquired lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Updating instance_info_cache with network_info: [{"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-5317f564-2a90-48f5-9c56-8fa65c48638e req-ee9a927e-6330-4c9e-8840-a653e99de28c service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received event network-changed-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-5317f564-2a90-48f5-9c56-8fa65c48638e req-ee9a927e-6330-4c9e-8840-a653e99de28c service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Refreshing instance network info cache due to event network-changed-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5317f564-2a90-48f5-9c56-8fa65c48638e req-ee9a927e-6330-4c9e-8840-a653e99de28c service nova] Acquiring lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Releasing lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Instance network_info: |[{"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-193a5493-3ae2-40e9-b0ea-94c4db28a546 req-ed410c33-e7bf-42e7-bc90-b90a88f49429 service nova] Acquired lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-193a5493-3ae2-40e9-b0ea-94c4db28a546 req-ed410c33-e7bf-42e7-bc90-b90a88f49429 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Refreshing network info cache for port f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Start _get_guest_xml network_info=[{"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:10:29 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:29 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-699772952',display_name='tempest-TestVolumeSwap-server-699772952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-699772952',id=9,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtun0L5+WgKKfY2o/1FsHinbOK323MiKO2O3tuPPb15tXxR/k5AXt004TqPJMlRN92V/Ahmr/VS8Unks27JD3UXTYzRE42yMXT91/LK7jDTnIqwtqx9sH+7OBd9H2f6FA==',key_name='tempest-keypair-2106385838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a54d0ad3b1e45a6acc243906b2483c0',ramdisk_id='',reservation_id='r-sihmshrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-441156882',owner_user_name='tempest-TestVolumeSwap-441156882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0ca9b1734834832b7eebf4fd4219a61',uuid=9791d36b-9111-47c7-aa6d-c86645e1a453,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Converting VIF {"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:9a,bridge_name='br-int',has_traffic_filtering=True,id=f1a21da6-a59f-430a-8b0b-2d0ed16ac211,network=Network(99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a21da6-a5') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lazy-loading 'pci_devices' on Instance uuid 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:10:29 user nova-compute[74681]:   <uuid>9791d36b-9111-47c7-aa6d-c86645e1a453</uuid>
Aug 16 06:10:29 user nova-compute[74681]:   <name>instance-00000009</name>
Aug 16 06:10:29 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:10:29 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:10:29 user nova-compute[74681]:   <metadata>
Aug 16 06:10:29 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:10:29 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:10:29 user nova-compute[74681]:       <nova:name>tempest-TestVolumeSwap-server-699772952</nova:name>
Aug 16 06:10:29 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:10:29</nova:creationTime>
Aug 16 06:10:29 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:10:29 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:10:29 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:10:29 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:10:29 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:10:29 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:10:29 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:10:29 user nova-compute[74681]:       <nova:owner>
Aug 16 06:10:29 user nova-compute[74681]:         <nova:user uuid="b0ca9b1734834832b7eebf4fd4219a61">tempest-TestVolumeSwap-441156882-project-member</nova:user>
Aug 16 06:10:29 user nova-compute[74681]:         <nova:project uuid="4a54d0ad3b1e45a6acc243906b2483c0">tempest-TestVolumeSwap-441156882</nova:project>
Aug 16 06:10:29 user nova-compute[74681]:       </nova:owner>
Aug 16 06:10:29 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:10:29 user nova-compute[74681]:       <nova:ports>
Aug 16 06:10:29 user nova-compute[74681]:         <nova:port uuid="f1a21da6-a59f-430a-8b0b-2d0ed16ac211">
Aug 16 06:10:29 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 06:10:29 user nova-compute[74681]:         </nova:port>
Aug 16 06:10:29 user nova-compute[74681]:       </nova:ports>
Aug 16 06:10:29 user nova-compute[74681]:     </nova:instance>
Aug 16 06:10:29 user nova-compute[74681]:   </metadata>
Aug 16 06:10:29 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:10:29 user nova-compute[74681]:     <system>
Aug 16 06:10:29 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:10:29 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:10:29 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:10:29 user nova-compute[74681]:       <entry name="serial">9791d36b-9111-47c7-aa6d-c86645e1a453</entry>
Aug 16 06:10:29 user nova-compute[74681]:       <entry name="uuid">9791d36b-9111-47c7-aa6d-c86645e1a453</entry>
Aug 16 06:10:29 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:10:29 user nova-compute[74681]:     </system>
Aug 16 06:10:29 user nova-compute[74681]:   </sysinfo>
Aug 16 06:10:29 user nova-compute[74681]:   <os>
Aug 16 06:10:29 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:10:29 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:10:29 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:10:29 user nova-compute[74681]:   </os>
Aug 16 06:10:29 user nova-compute[74681]:   <features>
Aug 16 06:10:29 user nova-compute[74681]:     <acpi/>
Aug 16 06:10:29 user nova-compute[74681]:     <apic/>
Aug 16 06:10:29 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:10:29 user nova-compute[74681]:   </features>
Aug 16 06:10:29 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:10:29 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:10:29 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:10:29 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:10:29 user nova-compute[74681]:   </clock>
Aug 16 06:10:29 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:10:29 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:10:29 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:10:29 user nova-compute[74681]:   </cpu>
Aug 16 06:10:29 user nova-compute[74681]:   <devices>
Aug 16 06:10:29 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:10:29 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:10:29 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk"/>
Aug 16 06:10:29 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:10:29 user nova-compute[74681]:     </disk>
Aug 16 06:10:29 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:10:29 user nova-compute[74681]:       <mac address="fa:16:3e:92:c7:9a"/>
Aug 16 06:10:29 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:29 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:10:29 user nova-compute[74681]:       <target dev="tapf1a21da6-a5"/>
Aug 16 06:10:29 user nova-compute[74681]:     </interface>
Aug 16 06:10:29 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:10:29 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/console.log" append="off"/>
Aug 16 06:10:29 user nova-compute[74681]:     </serial>
Aug 16 06:10:29 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:10:29 user nova-compute[74681]:     <video>
Aug 16 06:10:29 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:29 user nova-compute[74681]:     </video>
Aug 16 06:10:29 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:10:29 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:10:29 user nova-compute[74681]:     </rng>
Aug 16 06:10:29 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:10:29 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:10:29 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:10:29 user nova-compute[74681]:     </memballoon>
Aug 16 06:10:29 user nova-compute[74681]:   </devices>
Aug 16 06:10:29 user nova-compute[74681]: </domain>
Aug 16 06:10:29 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-699772952',display_name='tempest-TestVolumeSwap-server-699772952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-699772952',id=9,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtun0L5+WgKKfY2o/1FsHinbOK323MiKO2O3tuPPb15tXxR/k5AXt004TqPJMlRN92V/Ahmr/VS8Unks27JD3UXTYzRE42yMXT91/LK7jDTnIqwtqx9sH+7OBd9H2f6FA==',key_name='tempest-keypair-2106385838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a54d0ad3b1e45a6acc243906b2483c0',ramdisk_id='',reservation_id='r-sihmshrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-441156882',owner_user_name='tempest-TestVolumeSwap-441156882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0ca9b1734834832b7eebf4fd4219a61',uuid=9791d36b-9111-47c7-aa6d-c86645e1a453,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Converting VIF {"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:9a,bridge_name='br-int',has_traffic_filtering=True,id=f1a21da6-a59f-430a-8b0b-2d0ed16ac211,network=Network(99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a21da6-a5') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG os_vif [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:9a,bridge_name='br-int',has_traffic_filtering=True,id=f1a21da6-a59f-430a-8b0b-2d0ed16ac211,network=Network(99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a21da6-a5') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1a21da6-a5, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1a21da6-a5, col_values=(('external_ids', {'iface-id': 'f1a21da6-a59f-430a-8b0b-2d0ed16ac211', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:c7:9a', 'vm-uuid': '9791d36b-9111-47c7-aa6d-c86645e1a453'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:29 user nova-compute[74681]: INFO os_vif [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c7:9a,bridge_name='br-int',has_traffic_filtering=True,id=f1a21da6-a59f-430a-8b0b-2d0ed16ac211,network=Network(99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a21da6-a5')
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] No VIF found with MAC fa:16:3e:92:c7:9a, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:10:29 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Updating instance_info_cache with network_info: [{"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Releasing lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Instance network_info: |[{"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5317f564-2a90-48f5-9c56-8fa65c48638e req-ee9a927e-6330-4c9e-8840-a653e99de28c service nova] Acquired lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.network.neutron [req-5317f564-2a90-48f5-9c56-8fa65c48638e req-ee9a927e-6330-4c9e-8840-a653e99de28c service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Refreshing network info cache for port f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Start _get_guest_xml network_info=[{"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:10:30 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:30 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.network.neutron [req-193a5493-3ae2-40e9-b0ea-94c4db28a546 req-ed410c33-e7bf-42e7-bc90-b90a88f49429 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Updated VIF entry in instance network info cache for port f1a21da6-a59f-430a-8b0b-2d0ed16ac211. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.network.neutron [req-193a5493-3ae2-40e9-b0ea-94c4db28a546 req-ed410c33-e7bf-42e7-bc90-b90a88f49429 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Updating instance_info_cache with network_info: [{"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1568385333',display_name='tempest-VolumesAssistedSnapshotsTest-server-1568385333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1568385333',id=10,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEWD6oDRMn6gQdfdq+KDNHUKkwjbaQuw7Wyq7reKkaZtl5tl0TFzolnovLTcqnHGeq3YhGNHjSsqzMsAj4aWa18X7R0DpUdNrBy3x6DKwgUYdy/Vaehp+HJyb61laj18Q==',key_name='tempest-keypair-942216464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90b9899e5b2c4c208197b432e42dff8a',ramdisk_id='',reservation_id='r-voo5wexh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-759327546',owner_user_name='tempest-VolumesAssistedSnapshotsTest-759327546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='786261495dab40028aba9ec701354abf',uuid=2f74fd47-e29b-4392-9af3-eabed0d91993,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Converting VIF {"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f,network=Network(4c91a2af-8b00-4d9a-98ed-818167e395ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b07c78-fa') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f74fd47-e29b-4392-9af3-eabed0d91993 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-193a5493-3ae2-40e9-b0ea-94c4db28a546 req-ed410c33-e7bf-42e7-bc90-b90a88f49429 service nova] Releasing lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:10:30 user nova-compute[74681]:   <uuid>2f74fd47-e29b-4392-9af3-eabed0d91993</uuid>
Aug 16 06:10:30 user nova-compute[74681]:   <name>instance-0000000a</name>
Aug 16 06:10:30 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:10:30 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:10:30 user nova-compute[74681]:   <metadata>
Aug 16 06:10:30 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:10:30 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:10:30 user nova-compute[74681]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1568385333</nova:name>
Aug 16 06:10:30 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:10:30</nova:creationTime>
Aug 16 06:10:30 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:10:30 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:10:30 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:10:30 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:10:30 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:10:30 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:10:30 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:10:30 user nova-compute[74681]:       <nova:owner>
Aug 16 06:10:30 user nova-compute[74681]:         <nova:user uuid="786261495dab40028aba9ec701354abf">tempest-VolumesAssistedSnapshotsTest-759327546-project-member</nova:user>
Aug 16 06:10:30 user nova-compute[74681]:         <nova:project uuid="90b9899e5b2c4c208197b432e42dff8a">tempest-VolumesAssistedSnapshotsTest-759327546</nova:project>
Aug 16 06:10:30 user nova-compute[74681]:       </nova:owner>
Aug 16 06:10:30 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:10:30 user nova-compute[74681]:       <nova:ports>
Aug 16 06:10:30 user nova-compute[74681]:         <nova:port uuid="f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f">
Aug 16 06:10:30 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:10:30 user nova-compute[74681]:         </nova:port>
Aug 16 06:10:30 user nova-compute[74681]:       </nova:ports>
Aug 16 06:10:30 user nova-compute[74681]:     </nova:instance>
Aug 16 06:10:30 user nova-compute[74681]:   </metadata>
Aug 16 06:10:30 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:10:30 user nova-compute[74681]:     <system>
Aug 16 06:10:30 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:10:30 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:10:30 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:10:30 user nova-compute[74681]:       <entry name="serial">2f74fd47-e29b-4392-9af3-eabed0d91993</entry>
Aug 16 06:10:30 user nova-compute[74681]:       <entry name="uuid">2f74fd47-e29b-4392-9af3-eabed0d91993</entry>
Aug 16 06:10:30 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:10:30 user nova-compute[74681]:     </system>
Aug 16 06:10:30 user nova-compute[74681]:   </sysinfo>
Aug 16 06:10:30 user nova-compute[74681]:   <os>
Aug 16 06:10:30 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:10:30 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:10:30 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:10:30 user nova-compute[74681]:   </os>
Aug 16 06:10:30 user nova-compute[74681]:   <features>
Aug 16 06:10:30 user nova-compute[74681]:     <acpi/>
Aug 16 06:10:30 user nova-compute[74681]:     <apic/>
Aug 16 06:10:30 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:10:30 user nova-compute[74681]:   </features>
Aug 16 06:10:30 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:10:30 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:10:30 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:10:30 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:10:30 user nova-compute[74681]:   </clock>
Aug 16 06:10:30 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:10:30 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:10:30 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:10:30 user nova-compute[74681]:   </cpu>
Aug 16 06:10:30 user nova-compute[74681]:   <devices>
Aug 16 06:10:30 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:10:30 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:10:30 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk"/>
Aug 16 06:10:30 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:10:30 user nova-compute[74681]:     </disk>
Aug 16 06:10:30 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:10:30 user nova-compute[74681]:       <mac address="fa:16:3e:a4:d5:10"/>
Aug 16 06:10:30 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:30 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:10:30 user nova-compute[74681]:       <target dev="tapf4b07c78-fa"/>
Aug 16 06:10:30 user nova-compute[74681]:     </interface>
Aug 16 06:10:30 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:10:30 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/console.log" append="off"/>
Aug 16 06:10:30 user nova-compute[74681]:     </serial>
Aug 16 06:10:30 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:10:30 user nova-compute[74681]:     <video>
Aug 16 06:10:30 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:10:30 user nova-compute[74681]:     </video>
Aug 16 06:10:30 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:10:30 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:10:30 user nova-compute[74681]:     </rng>
Aug 16 06:10:30 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:10:30 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:10:30 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:10:30 user nova-compute[74681]:     </memballoon>
Aug 16 06:10:30 user nova-compute[74681]:   </devices>
Aug 16 06:10:30 user nova-compute[74681]: </domain>
Aug 16 06:10:30 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1568385333',display_name='tempest-VolumesAssistedSnapshotsTest-server-1568385333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1568385333',id=10,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEWD6oDRMn6gQdfdq+KDNHUKkwjbaQuw7Wyq7reKkaZtl5tl0TFzolnovLTcqnHGeq3YhGNHjSsqzMsAj4aWa18X7R0DpUdNrBy3x6DKwgUYdy/Vaehp+HJyb61laj18Q==',key_name='tempest-keypair-942216464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90b9899e5b2c4c208197b432e42dff8a',ramdisk_id='',reservation_id='r-voo5wexh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-759327546',owner_user_name='tempest-VolumesAssistedSnapshotsTest-759327546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='786261495dab40028aba9ec701354abf',uuid=2f74fd47-e29b-4392-9af3-eabed0d91993,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Converting VIF {"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f,network=Network(4c91a2af-8b00-4d9a-98ed-818167e395ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b07c78-fa') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG os_vif [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f,network=Network(4c91a2af-8b00-4d9a-98ed-818167e395ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b07c78-fa') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4b07c78-fa, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4b07c78-fa, col_values=(('external_ids', {'iface-id': 'f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:d5:10', 'vm-uuid': '2f74fd47-e29b-4392-9af3-eabed0d91993'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:30 user nova-compute[74681]: INFO os_vif [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f,network=Network(4c91a2af-8b00-4d9a-98ed-818167e395ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b07c78-fa')
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] No VIF found with MAC fa:16:3e:a4:d5:10, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Skipping network cache update for instance because it is Building. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Skipping network cache update for instance because it is Building. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Skipping network cache update for instance because it is Building. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Skipping network cache update for instance because it is Building. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:10:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 02e364f9-af4e-40bb-a0b4-2b1864f54270 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-5317f564-2a90-48f5-9c56-8fa65c48638e req-ee9a927e-6330-4c9e-8840-a653e99de28c service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Updated VIF entry in instance network info cache for port f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-5317f564-2a90-48f5-9c56-8fa65c48638e req-ee9a927e-6330-4c9e-8840-a653e99de28c service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Updating instance_info_cache with network_info: [{"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5317f564-2a90-48f5-9c56-8fa65c48638e req-ee9a927e-6330-4c9e-8840-a653e99de28c service nova] Releasing lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updating instance_info_cache with network_info: [{"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-7aa10401-2f31-4234-aa16-e4e409ad9cfe req-b5056f3f-f0cd-4a10-b6e1-67a1e5a4b87f service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received event network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7aa10401-2f31-4234-aa16-e4e409ad9cfe req-b5056f3f-f0cd-4a10-b6e1-67a1e5a4b87f service nova] Acquiring lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7aa10401-2f31-4234-aa16-e4e409ad9cfe req-b5056f3f-f0cd-4a10-b6e1-67a1e5a4b87f service nova] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7aa10401-2f31-4234-aa16-e4e409ad9cfe req-b5056f3f-f0cd-4a10-b6e1-67a1e5a4b87f service nova] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-7aa10401-2f31-4234-aa16-e4e409ad9cfe req-b5056f3f-f0cd-4a10-b6e1-67a1e5a4b87f service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] No waiting events found dispatching network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:31 user nova-compute[74681]: WARNING nova.compute.manager [req-7aa10401-2f31-4234-aa16-e4e409ad9cfe req-b5056f3f-f0cd-4a10-b6e1-67a1e5a4b87f service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received unexpected event network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd for instance with vm_state active and task_state None.
Aug 16 06:10:32 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-a1dc6650-0e8f-447b-afad-090d9efda210 req-ac1994e9-d42c-47a4-adfb-a76b85630bb3 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received event network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a1dc6650-0e8f-447b-afad-090d9efda210 req-ac1994e9-d42c-47a4-adfb-a76b85630bb3 service nova] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a1dc6650-0e8f-447b-afad-090d9efda210 req-ac1994e9-d42c-47a4-adfb-a76b85630bb3 service nova] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a1dc6650-0e8f-447b-afad-090d9efda210 req-ac1994e9-d42c-47a4-adfb-a76b85630bb3 service nova] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-a1dc6650-0e8f-447b-afad-090d9efda210 req-ac1994e9-d42c-47a4-adfb-a76b85630bb3 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] No waiting events found dispatching network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:32 user nova-compute[74681]: WARNING nova.compute.manager [req-a1dc6650-0e8f-447b-afad-090d9efda210 req-ac1994e9-d42c-47a4-adfb-a76b85630bb3 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received unexpected event network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f for instance with vm_state building and task_state spawning.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166233.5231981, 76acb01b-43fd-4a5b-990d-ee95e09aeeab => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:33 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] VM Resumed (Lifecycle Event)
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Instance spawned successfully.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:33 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166233.5268202, 76acb01b-43fd-4a5b-990d-ee95e09aeeab => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:33 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] VM Started (Lifecycle Event)
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:33 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:33 user nova-compute[74681]: INFO nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Took 11.87 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:33 user nova-compute[74681]: INFO nova.compute.manager [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Took 13.12 seconds to build instance.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-42748f2d-e477-42d9-a7ab-a250bcec5f7f tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.296s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received event network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Acquiring lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] No waiting events found dispatching network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:33 user nova-compute[74681]: WARNING nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received unexpected event network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd for instance with vm_state active and task_state None.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received event network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] No waiting events found dispatching network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:33 user nova-compute[74681]: WARNING nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received unexpected event network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 for instance with vm_state active and task_state None.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received event network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] No waiting events found dispatching network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:33 user nova-compute[74681]: WARNING nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received unexpected event network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 for instance with vm_state active and task_state None.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received event network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] No waiting events found dispatching network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:33 user nova-compute[74681]: WARNING nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received unexpected event network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c for instance with vm_state active and task_state None.
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received event network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] No waiting events found dispatching network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:33 user nova-compute[74681]: WARNING nova.compute.manager [req-90739a65-5a59-45cf-93cc-3cc2f787b95d req-57e0af05-002f-48f0-9d4d-3e12bcd8b88b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received unexpected event network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c for instance with vm_state active and task_state None.
Aug 16 06:10:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received event network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] No waiting events found dispatching network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:35 user nova-compute[74681]: WARNING nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received unexpected event network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f for instance with vm_state building and task_state spawning.
Aug 16 06:10:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received event network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] No waiting events found dispatching network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:35 user nova-compute[74681]: WARNING nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received unexpected event network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d for instance with vm_state building and task_state spawning.
Aug 16 06:10:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received event network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] No waiting events found dispatching network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:35 user nova-compute[74681]: WARNING nova.compute.manager [req-efb640cf-1c92-4c8f-bdd2-104ee740e60f req-eaf7fd1b-b822-45cf-a696-6c11edf25a8e service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received unexpected event network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d for instance with vm_state building and task_state spawning.
Aug 16 06:10:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166236.592759, 903e763a-6ec7-415a-8db9-c5330cd93aec => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] VM Resumed (Lifecycle Event)
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Instance spawned successfully.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Instance spawned successfully.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166236.5980043, 903e763a-6ec7-415a-8db9-c5330cd93aec => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] VM Started (Lifecycle Event)
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Instance spawned successfully.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166236.6204443, 9791d36b-9111-47c7-aa6d-c86645e1a453 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] VM Resumed (Lifecycle Event)
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Took 13.62 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Took 12.27 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166236.6228392, 9791d36b-9111-47c7-aa6d-c86645e1a453 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] VM Started (Lifecycle Event)
Aug 16 06:10:36 user nova-compute[74681]: INFO nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Took 9.74 seconds to spawn the instance on the hypervisor.
Aug 16 06:10:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:37 user nova-compute[74681]: INFO nova.compute.manager [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Took 14.74 seconds to build instance.
Aug 16 06:10:37 user nova-compute[74681]: INFO nova.compute.manager [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Took 14.97 seconds to build instance.
Aug 16 06:10:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fc60d439-4ef5-494a-8753-a28da47d0580 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.981s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d0165f83-d5ab-4440-baa7-f9961fd3d6bf tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.140s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166236.731479, 2f74fd47-e29b-4392-9af3-eabed0d91993 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] VM Resumed (Lifecycle Event)
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:37 user nova-compute[74681]: INFO nova.compute.manager [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Took 11.54 seconds to build instance.
Aug 16 06:10:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4ee00e6c-b496-48ba-a04e-4cb6fd749f69 tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.737s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166236.7328656, 2f74fd47-e29b-4392-9af3-eabed0d91993 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:10:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] VM Started (Lifecycle Event)
Aug 16 06:10:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:10:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-f2c6460e-6b6e-4307-bdc8-dbc51afe7ce8 req-0d13bf2a-57fe-4714-94b3-3f1c7d1cb26e service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f2c6460e-6b6e-4307-bdc8-dbc51afe7ce8 req-0d13bf2a-57fe-4714-94b3-3f1c7d1cb26e service nova] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f2c6460e-6b6e-4307-bdc8-dbc51afe7ce8 req-0d13bf2a-57fe-4714-94b3-3f1c7d1cb26e service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f2c6460e-6b6e-4307-bdc8-dbc51afe7ce8 req-0d13bf2a-57fe-4714-94b3-3f1c7d1cb26e service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-f2c6460e-6b6e-4307-bdc8-dbc51afe7ce8 req-0d13bf2a-57fe-4714-94b3-3f1c7d1cb26e service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] No waiting events found dispatching network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:39 user nova-compute[74681]: WARNING nova.compute.manager [req-f2c6460e-6b6e-4307-bdc8-dbc51afe7ce8 req-0d13bf2a-57fe-4714-94b3-3f1c7d1cb26e service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received unexpected event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 for instance with vm_state active and task_state None.
Aug 16 06:10:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:10:40 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:40 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7500MB free_disk=25.85531997680664GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3fa19b27-7628-44ce-b0ae-e1e870337855 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 70390b89-fdfb-4552-98e5-35568c0268bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance d7bc97ea-3b81-488c-8c63-b83a351118d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 90188af1-901c-453f-b113-133b1e86bc85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 903e763a-6ec7-415a-8db9-c5330cd93aec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 9791d36b-9111-47c7-aa6d-c86645e1a453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 2f74fd47-e29b-4392-9af3-eabed0d91993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing inventories for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating ProviderTree inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing aggregate associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, aggregates: None {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 06:10:40 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing trait associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] No waiting events found dispatching network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:41 user nova-compute[74681]: WARNING nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received unexpected event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 for instance with vm_state active and task_state None.
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received event network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] No waiting events found dispatching network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:41 user nova-compute[74681]: WARNING nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received unexpected event network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 for instance with vm_state active and task_state None.
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received event network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] No waiting events found dispatching network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:41 user nova-compute[74681]: WARNING nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received unexpected event network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 for instance with vm_state active and task_state None.
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] No waiting events found dispatching network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:41 user nova-compute[74681]: WARNING nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received unexpected event network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 for instance with vm_state active and task_state None.
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] No waiting events found dispatching network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:41 user nova-compute[74681]: WARNING nova.compute.manager [req-4fbf5514-859f-4faa-bbd7-95fb50a0f9ee req-2a0d5c1b-08de-4bfc-9de0-798dd9e3aeba service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received unexpected event network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 for instance with vm_state active and task_state None.
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.349s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-90d610fe-18b8-4bd8-a1b0-b8af03bcf357 req-e9adf3e9-4b45-480f-a580-98fd17473570 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received event network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90d610fe-18b8-4bd8-a1b0-b8af03bcf357 req-e9adf3e9-4b45-480f-a580-98fd17473570 service nova] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90d610fe-18b8-4bd8-a1b0-b8af03bcf357 req-e9adf3e9-4b45-480f-a580-98fd17473570 service nova] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-90d610fe-18b8-4bd8-a1b0-b8af03bcf357 req-e9adf3e9-4b45-480f-a580-98fd17473570 service nova] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-90d610fe-18b8-4bd8-a1b0-b8af03bcf357 req-e9adf3e9-4b45-480f-a580-98fd17473570 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] No waiting events found dispatching network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:41 user nova-compute[74681]: WARNING nova.compute.manager [req-90d610fe-18b8-4bd8-a1b0-b8af03bcf357 req-e9adf3e9-4b45-480f-a580-98fd17473570 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received unexpected event network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 for instance with vm_state active and task_state None.
Aug 16 06:10:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-53075f55-0b10-4b6b-b9f0-469748e581c8 req-6d05b1bc-671b-46d5-952f-e6dbfe1fc6c8 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received event network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:10:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-53075f55-0b10-4b6b-b9f0-469748e581c8 req-6d05b1bc-671b-46d5-952f-e6dbfe1fc6c8 service nova] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:10:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-53075f55-0b10-4b6b-b9f0-469748e581c8 req-6d05b1bc-671b-46d5-952f-e6dbfe1fc6c8 service nova] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:10:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-53075f55-0b10-4b6b-b9f0-469748e581c8 req-6d05b1bc-671b-46d5-952f-e6dbfe1fc6c8 service nova] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:10:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-53075f55-0b10-4b6b-b9f0-469748e581c8 req-6d05b1bc-671b-46d5-952f-e6dbfe1fc6c8 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] No waiting events found dispatching network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:10:44 user nova-compute[74681]: WARNING nova.compute.manager [req-53075f55-0b10-4b6b-b9f0-469748e581c8 req-6d05b1bc-671b-46d5-952f-e6dbfe1fc6c8 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received unexpected event network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 for instance with vm_state active and task_state None.
Aug 16 06:10:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:10:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:11:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:18 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:11:18 user nova-compute[74681]: INFO nova.compute.claims [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Claim successful on node user
Aug 16 06:11:19 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:11:19 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:11:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:11:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:11:19 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:11:19 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:11:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:11:19 user nova-compute[74681]: INFO nova.virt.block_device [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Booting with volume d2dce38e-94a3-4add-83f4-8d153c6adad7 at /dev/vda
Aug 16 06:11:19 user nova-compute[74681]: DEBUG nova.policy [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '842f744ea91e4c12bc1bf04f725c5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ad3bf69ae47cd9c3b28f8b4174568', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:11:19 user nova-compute[74681]: DEBUG os_brick.utils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:11:19 user nova-compute[74681]: INFO oslo.privsep.daemon [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp9dvysphy/privsep.sock']
Aug 16 06:11:19 user sudo[121295]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp9dvysphy/privsep.sock
Aug 16 06:11:19 user sudo[121295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 06:11:19 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully created port: b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:20 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully created port: e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully created port: 59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:21 user sudo[121295]: pam_unix(sudo:session): session closed for user root
Aug 16 06:11:21 user nova-compute[74681]: INFO oslo.privsep.daemon [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Spawned new privsep daemon via rootwrap
Aug 16 06:11:21 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 06:11:21 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 06:11:21 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 06:11:21 user nova-compute[74681]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 121298
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3839b427-2acc-417b-b154-0f641237ef17]: (2,) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[16be1ea2-1278-47a7-b68b-6d593df38fea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:21 user nova-compute[74681]: WARNING os_brick.initiator.connectors.nvmeof [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38483fa-a453-4ea7-a9a8-dad359dfba3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e6f0c-b801-49cf-81b5-63c9c7e2b621]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39d3ec7-56b7-4206-84d8-bbd8844fd00e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:21 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:11:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705c69b-8f9b-4d11-9ca1-5b8ef5ff70e2]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG os_brick.utils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== get_connector_properties: return (2049ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating existing volume attachment record: e61bd32b-520f-40a9-8411-705982fa927f {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:11:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully created port: 30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully created port: c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully updated port: b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG nova.compute.manager [req-898fb126-e58e-4b79-bd7d-79a31ac56a66 req-e6c638c1-c17d-4f3a-b86c-af01adfb66a1 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-changed-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG nova.compute.manager [req-898fb126-e58e-4b79-bd7d-79a31ac56a66 req-e6c638c1-c17d-4f3a-b86c-af01adfb66a1 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing instance network info cache due to event network-changed-b5f52a79-949a-4249-afc8-049040df17a1. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-898fb126-e58e-4b79-bd7d-79a31ac56a66 req-e6c638c1-c17d-4f3a-b86c-af01adfb66a1 service nova] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-898fb126-e58e-4b79-bd7d-79a31ac56a66 req-e6c638c1-c17d-4f3a-b86c-af01adfb66a1 service nova] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-898fb126-e58e-4b79-bd7d-79a31ac56a66 req-e6c638c1-c17d-4f3a-b86c-af01adfb66a1 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing network info cache for port b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-898fb126-e58e-4b79-bd7d-79a31ac56a66 req-e6c638c1-c17d-4f3a-b86c-af01adfb66a1 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-898fb126-e58e-4b79-bd7d-79a31ac56a66 req-e6c638c1-c17d-4f3a-b86c-af01adfb66a1 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-898fb126-e58e-4b79-bd7d-79a31ac56a66 req-e6c638c1-c17d-4f3a-b86c-af01adfb66a1 service nova] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:24 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully updated port: bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:24 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully updated port: c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-changed-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing instance network info cache due to event network-changed-bb1026fe-e425-441b-ad89-37e2d6e125de. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.network.neutron [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing network info cache for port bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.network.neutron [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.network.neutron [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-changed-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing instance network info cache due to event network-changed-c6d84664-b42d-4b02-a71a-17c3471e5bf3. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.network.neutron [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing network info cache for port c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully updated port: e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.network.neutron [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.network.neutron [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7ce7f4-a559-43b2-a032-e475e7593c10 req-d4156f92-6985-4399-9ada-7d366d122e42 service nova] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:11:25 user nova-compute[74681]: INFO nova.compute.claims [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Claim successful on node user
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully updated port: 59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:11:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:11:26 user nova-compute[74681]: INFO nova.virt.block_device [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Booting with volume f4b86c91-e1b5-4e3f-8c24-12d92e6b899d at /dev/vda
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.policy [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df7ed94a0d504fb082655852eacc3f50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83bf6983951747c287a2099077b61233', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG os_brick.utils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49e7a5d-f9e1-4d46-92f5-c8803140effa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[38086ece-e253-4c9a-afe4-4edc587fd076]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4499a09-5097-454c-a9af-9149fbfb5a73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a267a95b-09a3-4f3a-ab3c-b04321575c37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:26 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:11:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6010996b-27fd-4c9e-a3f3-15e24e204ed4]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG os_brick.utils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:11:26 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating existing volume attachment record: b7c48330-e6fa-42b1-bfd0-2c42509459b2 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully updated port: 30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-changed-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing instance network info cache due to event network-changed-e9336b44-5798-4ac0-ae76-404bc96738a9. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing network info cache for port e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully created port: 2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-changed-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing instance network info cache due to event network-changed-59f6c45b-5dbf-43f3-936f-fd4280d13103. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing network info cache for port 59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Successfully updated port: c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-changed-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing instance network info cache due to event network-changed-30bbb3b0-cdf3-46b3-b418-e908e295b5b2. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing network info cache for port 30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully created port: 9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d83e021-b5af-4400-bc3f-e4b054994db1 req-f1be7d0c-89ff-4a42-a205-a624715933a5 service nova] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:11:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-544006fc-7e1b-473d-87ec-92b60333f6ef req-8de6de4c-dc8e-4f63-89de-c84b59bbeed3 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-changed-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-544006fc-7e1b-473d-87ec-92b60333f6ef req-8de6de4c-dc8e-4f63-89de-c84b59bbeed3 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing instance network info cache due to event network-changed-c1128321-8d72-4bd5-a749-65b9b6adb4ee. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-544006fc-7e1b-473d-87ec-92b60333f6ef req-8de6de4c-dc8e-4f63-89de-c84b59bbeed3 service nova] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:29 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully created port: 7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:11:30 user nova-compute[74681]: INFO nova.virt.block_device [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Booting with volume 5047d252-a8d1-497c-b7f9-4e53b36ba767 at /dev/vdb
Aug 16 06:11:30 user nova-compute[74681]: DEBUG os_brick.utils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2ca4c3-2c44-441f-9391-4a65173b61e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb24612-e356-42c3-b11b-6cbc73e2661f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0603bd13-df3f-4295-8ed8-cd2f4b4bdbf2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98ee58-d3ab-451b-ba04-3a32bc946022]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully created port: 048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:30 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:11:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3df964-3da3-4c72-832a-26f79b2f3d3d]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG os_brick.utils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:11:30 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating existing volume attachment record: 8599d49a-2614-4713-9792-54e12f27b64e {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:11:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully created port: 368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:32 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [{"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance network_info: |[{"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:11:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-544006fc-7e1b-473d-87ec-92b60333f6ef req-8de6de4c-dc8e-4f63-89de-c84b59bbeed3 service nova] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-544006fc-7e1b-473d-87ec-92b60333f6ef req-8de6de4c-dc8e-4f63-89de-c84b59bbeed3 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing network info cache for port c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "266431b4-b49b-4079-b5c7-c0f59f46d201" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:11:33 user nova-compute[74681]: INFO nova.compute.claims [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Claim successful on node user
Aug 16 06:11:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-544006fc-7e1b-473d-87ec-92b60333f6ef req-8de6de4c-dc8e-4f63-89de-c84b59bbeed3 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updated VIF entry in instance network info cache for port c1128321-8d72-4bd5-a749-65b9b6adb4ee. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-544006fc-7e1b-473d-87ec-92b60333f6ef req-8de6de4c-dc8e-4f63-89de-c84b59bbeed3 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [{"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully updated port: 2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-544006fc-7e1b-473d-87ec-92b60333f6ef req-8de6de4c-dc8e-4f63-89de-c84b59bbeed3 service nova] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-5bac51e8-40fe-4026-b7ac-b7d204cdf639 req-72e9b123-fda0-43ab-ae9c-d1927dc3f91b service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-changed-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-5bac51e8-40fe-4026-b7ac-b7d204cdf639 req-72e9b123-fda0-43ab-ae9c-d1927dc3f91b service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing instance network info cache due to event network-changed-2444d2a9-2e73-4b49-8a8c-431f68776ab9. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5bac51e8-40fe-4026-b7ac-b7d204cdf639 req-72e9b123-fda0-43ab-ae9c-d1927dc3f91b service nova] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5bac51e8-40fe-4026-b7ac-b7d204cdf639 req-72e9b123-fda0-43ab-ae9c-d1927dc3f91b service nova] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-5bac51e8-40fe-4026-b7ac-b7d204cdf639 req-72e9b123-fda0-43ab-ae9c-d1927dc3f91b service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing network info cache for port 2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-5bac51e8-40fe-4026-b7ac-b7d204cdf639 req-72e9b123-fda0-43ab-ae9c-d1927dc3f91b service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-5bac51e8-40fe-4026-b7ac-b7d204cdf639 req-72e9b123-fda0-43ab-ae9c-d1927dc3f91b service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5bac51e8-40fe-4026-b7ac-b7d204cdf639 req-72e9b123-fda0-43ab-ae9c-d1927dc3f91b service nova] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:11:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:11:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Creating image(s)
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "/opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "/opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "/opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG nova.policy [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f41156e5aac4c49b8d79b28fe9759d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4497e1bbb04a6badebffb1fe54b82a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk 1073741824" returned: 0 in 0.048s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.201s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully updated port: 3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Cannot resize image /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lazy-loading 'migration_context' on Instance uuid 266431b4-b49b-4079-b5c7-c0f59f46d201 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Ensure instance console log exists: /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:35 user nova-compute[74681]: DEBUG nova.network.neutron [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Successfully created port: 2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-a6da6a94-5cc5-4c8e-812d-174eca8ad2e1 req-6c3d52f3-a7ce-40ea-83b0-b723cb4b66f4 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-changed-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-a6da6a94-5cc5-4c8e-812d-174eca8ad2e1 req-6c3d52f3-a7ce-40ea-83b0-b723cb4b66f4 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing instance network info cache due to event network-changed-3bca746f-2df6-435e-85c2-f789ea8a5b8f. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a6da6a94-5cc5-4c8e-812d-174eca8ad2e1 req-6c3d52f3-a7ce-40ea-83b0-b723cb4b66f4 service nova] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a6da6a94-5cc5-4c8e-812d-174eca8ad2e1 req-6c3d52f3-a7ce-40ea-83b0-b723cb4b66f4 service nova] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG nova.network.neutron [req-a6da6a94-5cc5-4c8e-812d-174eca8ad2e1 req-6c3d52f3-a7ce-40ea-83b0-b723cb4b66f4 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing network info cache for port 3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG nova.network.neutron [req-a6da6a94-5cc5-4c8e-812d-174eca8ad2e1 req-6c3d52f3-a7ce-40ea-83b0-b723cb4b66f4 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG nova.network.neutron [req-a6da6a94-5cc5-4c8e-812d-174eca8ad2e1 req-6c3d52f3-a7ce-40ea-83b0-b723cb4b66f4 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a6da6a94-5cc5-4c8e-812d-174eca8ad2e1 req-6c3d52f3-a7ce-40ea-83b0-b723cb4b66f4 service nova] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully updated port: 14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.neutron [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Successfully updated port: 2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "refresh_cache-266431b4-b49b-4079-b5c7-c0f59f46d201" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquired lock "refresh_cache-266431b4-b49b-4079-b5c7-c0f59f46d201" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.neutron [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.neutron [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.neutron [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Updating instance_info_cache with network_info: [{"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Releasing lock "refresh_cache-266431b4-b49b-4079-b5c7-c0f59f46d201" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Instance network_info: |[{"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Start _get_guest_xml network_info=[{"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:11:37 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:11:37 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1523144636',display_name='tempest-ServersNegativeTestJSON-server-1523144636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1523144636',id=13,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4497e1bbb04a6badebffb1fe54b82a',ramdisk_id='',reservation_id='r-t7v9uckb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1958763636',owner_user_name='tempest-ServersNegativeTestJSON-1958763636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:34Z,user_data=None,user_id='9f41156e5aac4c49b8d79b28fe9759d9',uuid=266431b4-b49b-4079-b5c7-c0f59f46d201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converting VIF {"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:82:79,bridge_name='br-int',has_traffic_filtering=True,id=2bffd574-62c7-4330-b3ba-399d23e34fa4,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bffd574-62') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lazy-loading 'pci_devices' on Instance uuid 266431b4-b49b-4079-b5c7-c0f59f46d201 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:11:37 user nova-compute[74681]:   <uuid>266431b4-b49b-4079-b5c7-c0f59f46d201</uuid>
Aug 16 06:11:37 user nova-compute[74681]:   <name>instance-0000000d</name>
Aug 16 06:11:37 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:11:37 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:11:37 user nova-compute[74681]:   <metadata>
Aug 16 06:11:37 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:11:37 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:11:37 user nova-compute[74681]:       <nova:name>tempest-ServersNegativeTestJSON-server-1523144636</nova:name>
Aug 16 06:11:37 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:11:37</nova:creationTime>
Aug 16 06:11:37 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:11:37 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:11:37 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:11:37 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:11:37 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:11:37 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:11:37 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:11:37 user nova-compute[74681]:       <nova:owner>
Aug 16 06:11:37 user nova-compute[74681]:         <nova:user uuid="9f41156e5aac4c49b8d79b28fe9759d9">tempest-ServersNegativeTestJSON-1958763636-project-member</nova:user>
Aug 16 06:11:37 user nova-compute[74681]:         <nova:project uuid="3c4497e1bbb04a6badebffb1fe54b82a">tempest-ServersNegativeTestJSON-1958763636</nova:project>
Aug 16 06:11:37 user nova-compute[74681]:       </nova:owner>
Aug 16 06:11:37 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:11:37 user nova-compute[74681]:       <nova:ports>
Aug 16 06:11:37 user nova-compute[74681]:         <nova:port uuid="2bffd574-62c7-4330-b3ba-399d23e34fa4">
Aug 16 06:11:37 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:11:37 user nova-compute[74681]:         </nova:port>
Aug 16 06:11:37 user nova-compute[74681]:       </nova:ports>
Aug 16 06:11:37 user nova-compute[74681]:     </nova:instance>
Aug 16 06:11:37 user nova-compute[74681]:   </metadata>
Aug 16 06:11:37 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:11:37 user nova-compute[74681]:     <system>
Aug 16 06:11:37 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:11:37 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:11:37 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:11:37 user nova-compute[74681]:       <entry name="serial">266431b4-b49b-4079-b5c7-c0f59f46d201</entry>
Aug 16 06:11:37 user nova-compute[74681]:       <entry name="uuid">266431b4-b49b-4079-b5c7-c0f59f46d201</entry>
Aug 16 06:11:37 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:11:37 user nova-compute[74681]:     </system>
Aug 16 06:11:37 user nova-compute[74681]:   </sysinfo>
Aug 16 06:11:37 user nova-compute[74681]:   <os>
Aug 16 06:11:37 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:11:37 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:11:37 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:11:37 user nova-compute[74681]:   </os>
Aug 16 06:11:37 user nova-compute[74681]:   <features>
Aug 16 06:11:37 user nova-compute[74681]:     <acpi/>
Aug 16 06:11:37 user nova-compute[74681]:     <apic/>
Aug 16 06:11:37 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:11:37 user nova-compute[74681]:   </features>
Aug 16 06:11:37 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:11:37 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:11:37 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:11:37 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:11:37 user nova-compute[74681]:   </clock>
Aug 16 06:11:37 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:11:37 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:11:37 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:11:37 user nova-compute[74681]:   </cpu>
Aug 16 06:11:37 user nova-compute[74681]:   <devices>
Aug 16 06:11:37 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:11:37 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:11:37 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk"/>
Aug 16 06:11:37 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:11:37 user nova-compute[74681]:     </disk>
Aug 16 06:11:37 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:11:37 user nova-compute[74681]:       <mac address="fa:16:3e:da:82:79"/>
Aug 16 06:11:37 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:11:37 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:11:37 user nova-compute[74681]:       <target dev="tap2bffd574-62"/>
Aug 16 06:11:37 user nova-compute[74681]:     </interface>
Aug 16 06:11:37 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:11:37 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/console.log" append="off"/>
Aug 16 06:11:37 user nova-compute[74681]:     </serial>
Aug 16 06:11:37 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:11:37 user nova-compute[74681]:     <video>
Aug 16 06:11:37 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:11:37 user nova-compute[74681]:     </video>
Aug 16 06:11:37 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:11:37 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:11:37 user nova-compute[74681]:     </rng>
Aug 16 06:11:37 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:11:37 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:11:37 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:11:37 user nova-compute[74681]:     </memballoon>
Aug 16 06:11:37 user nova-compute[74681]:   </devices>
Aug 16 06:11:37 user nova-compute[74681]: </domain>
Aug 16 06:11:37 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1523144636',display_name='tempest-ServersNegativeTestJSON-server-1523144636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1523144636',id=13,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4497e1bbb04a6badebffb1fe54b82a',ramdisk_id='',reservation_id='r-t7v9uckb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1958763636',owner_user_name='tempest-ServersNegativeTestJSON-1958763636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:34Z,user_data=None,user_id='9f41156e5aac4c49b8d79b28fe9759d9',uuid=266431b4-b49b-4079-b5c7-c0f59f46d201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converting VIF {"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:82:79,bridge_name='br-int',has_traffic_filtering=True,id=2bffd574-62c7-4330-b3ba-399d23e34fa4,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bffd574-62') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG os_vif [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:82:79,bridge_name='br-int',has_traffic_filtering=True,id=2bffd574-62c7-4330-b3ba-399d23e34fa4,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bffd574-62') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bffd574-62, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bffd574-62, col_values=(('external_ids', {'iface-id': '2bffd574-62c7-4330-b3ba-399d23e34fa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:82:79', 'vm-uuid': '266431b4-b49b-4079-b5c7-c0f59f46d201'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:37 user nova-compute[74681]: INFO os_vif [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:82:79,bridge_name='br-int',has_traffic_filtering=True,id=2bffd574-62c7-4330-b3ba-399d23e34fa4,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bffd574-62')
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] No VIF found with MAC fa:16:3e:da:82:79, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:11:37 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully updated port: 9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-changed-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing instance network info cache due to event network-changed-14771914-909d-4cb0-a675-0a818671475d. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing network info cache for port 14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received event network-changed-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Refreshing instance network info cache due to event network-changed-2bffd574-62c7-4330-b3ba-399d23e34fa4. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Acquiring lock "refresh_cache-266431b4-b49b-4079-b5c7-c0f59f46d201" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Acquired lock "refresh_cache-266431b4-b49b-4079-b5c7-c0f59f46d201" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:38 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Refreshing network info cache for port 2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-055c4bc7-cc20-46c0-805b-8d3a21439edc req-e788e038-16e7-4d62-8e96-bcea79940ed6 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received event network-changed-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-055c4bc7-cc20-46c0-805b-8d3a21439edc req-e788e038-16e7-4d62-8e96-bcea79940ed6 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Refreshing instance network info cache due to event network-changed-a62d2031-a7e7-4e14-91ce-11c5603ce3b4. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-055c4bc7-cc20-46c0-805b-8d3a21439edc req-e788e038-16e7-4d62-8e96-bcea79940ed6 service nova] Acquiring lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-055c4bc7-cc20-46c0-805b-8d3a21439edc req-e788e038-16e7-4d62-8e96-bcea79940ed6 service nova] Acquired lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-055c4bc7-cc20-46c0-805b-8d3a21439edc req-e788e038-16e7-4d62-8e96-bcea79940ed6 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Refreshing network info cache for port a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Updated VIF entry in instance network info cache for port 2bffd574-62c7-4330-b3ba-399d23e34fa4. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Updating instance_info_cache with network_info: [{"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully updated port: 7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Releasing lock "refresh_cache-266431b4-b49b-4079-b5c7-c0f59f46d201" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-changed-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing instance network info cache due to event network-changed-9bb0411a-1cc3-491e-92a5-c5e54215a898. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing network info cache for port 9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b8a356a9-489d-4796-a386-7af96248f65b req-7dbd036a-a35e-419b-9742-09425bcb05ce service nova] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.network.neutron [req-055c4bc7-cc20-46c0-805b-8d3a21439edc req-e788e038-16e7-4d62-8e96-bcea79940ed6 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updated VIF entry in instance network info cache for port a62d2031-a7e7-4e14-91ce-11c5603ce3b4. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.network.neutron [req-055c4bc7-cc20-46c0-805b-8d3a21439edc req-e788e038-16e7-4d62-8e96-bcea79940ed6 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updating instance_info_cache with network_info: [{"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-055c4bc7-cc20-46c0-805b-8d3a21439edc req-e788e038-16e7-4d62-8e96-bcea79940ed6 service nova] Releasing lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-changed-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing instance network info cache due to event network-changed-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.network.neutron [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing network info cache for port 7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.network.neutron [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updating instance_info_cache with network_info: [{"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-3fa19b27-7628-44ce-b0ae-e1e870337855" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:11:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.network.neutron [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received event network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] Acquiring lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] No waiting events found dispatching network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:11:41 user nova-compute[74681]: WARNING nova.compute.manager [req-38dd4e39-fd41-4dc8-855b-25b5821fbb3d req-61fce486-b857-4d4e-ae4c-0e0fe1e48c02 service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received unexpected event network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 for instance with vm_state building and task_state spawning.
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully updated port: 048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166301.6668744, 266431b4-b49b-4079-b5c7-c0f59f46d201 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:11:41 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] VM Resumed (Lifecycle Event)
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:11:41 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Instance spawned successfully.
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:11:41 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166301.6675892, 266431b4-b49b-4079-b5c7-c0f59f46d201 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:11:41 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] VM Started (Lifecycle Event)
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:11:41 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:11:41 user nova-compute[74681]: INFO nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Took 7.29 seconds to spawn the instance on the hypervisor.
Aug 16 06:11:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Successfully updated port: 368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:11:42 user nova-compute[74681]: INFO nova.compute.manager [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Took 8.20 seconds to build instance.
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e23257d2-e35c-4442-ba09-a4f7f9f5b1d5 tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.308s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received event network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Acquiring lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] No waiting events found dispatching network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:11:42 user nova-compute[74681]: WARNING nova.compute.manager [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received unexpected event network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 for instance with vm_state active and task_state None.
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-changed-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing instance network info cache due to event network-changed-048cf7d9-d093-41eb-b546-a00c669a3dab. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-a39c433b-6348-4fe8-a637-e1c5cd0f5dd2 req-a01c74c9-5614-4ab8-9ea6-c1abe8dbd064 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received event network-changed-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-a39c433b-6348-4fe8-a637-e1c5cd0f5dd2 req-a01c74c9-5614-4ab8-9ea6-c1abe8dbd064 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Refreshing instance network info cache due to event network-changed-d431340f-a0ca-42db-aa2d-0a1a0e885c9c. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a39c433b-6348-4fe8-a637-e1c5cd0f5dd2 req-a01c74c9-5614-4ab8-9ea6-c1abe8dbd064 service nova] Acquiring lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a39c433b-6348-4fe8-a637-e1c5cd0f5dd2 req-a01c74c9-5614-4ab8-9ea6-c1abe8dbd064 service nova] Acquired lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG nova.network.neutron [req-a39c433b-6348-4fe8-a637-e1c5cd0f5dd2 req-a01c74c9-5614-4ab8-9ea6-c1abe8dbd064 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Refreshing network info cache for port d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:42 user nova-compute[74681]: INFO nova.virt.block_device [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Booting with volume fb087afb-be48-4a76-92a5-46940f01d7ce at /dev/vdb
Aug 16 06:11:42 user nova-compute[74681]: DEBUG os_brick.utils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:11:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d27654c-9800-4100-b2c0-f2f7775e3ad6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbbf423-3b5f-4d8a-921d-f64639f93058]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4380a04c-0560-462c-9e5f-21d423f0fd85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e57050d-52f6-4ae3-8f8f-dd16624f8691]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:43 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1fdd7e-8e34-40ce-908c-546ba0cb8be9]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG os_brick.utils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating existing volume attachment record: b9e0aa04-577c-4379-971f-4c9bbd50ba55 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-a39c433b-6348-4fe8-a637-e1c5cd0f5dd2 req-a01c74c9-5614-4ab8-9ea6-c1abe8dbd064 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updated VIF entry in instance network info cache for port d431340f-a0ca-42db-aa2d-0a1a0e885c9c. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-a39c433b-6348-4fe8-a637-e1c5cd0f5dd2 req-a01c74c9-5614-4ab8-9ea6-c1abe8dbd064 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating instance_info_cache with network_info: [{"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a39c433b-6348-4fe8-a637-e1c5cd0f5dd2 req-a01c74c9-5614-4ab8-9ea6-c1abe8dbd064 service nova] Releasing lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG nova.objects.instance [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 3fa19b27-7628-44ce-b0ae-e1e870337855 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.152s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:44 user nova-compute[74681]: INFO nova.compute.manager [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Attaching volume 2ceb578a-53e8-49b1-a5a7-512c5031efa1 to /dev/vdb
Aug 16 06:11:44 user nova-compute[74681]: DEBUG os_brick.utils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8c89ec-46f6-4fd9-bcf9-5eab60b6d9c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26f20ae-59ee-423b-aaf9-e98028537599]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf490fc-486d-418f-ad9a-24b5c7eeee16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bc3894-cd5c-4e58-b33b-bea4cd9fb740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:44 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eb607d-0abd-473f-8431-3f776a54649b]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG os_brick.utils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updating existing volume attachment record: 26401e26-8d59-4bbc-866e-8df9f9f000b1 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [{"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance network_info: |[{"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG nova.network.neutron [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing network info cache for port 048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-baddeb1e-cbaf-4163-b11a-a0bdb746d399 req-9a4577b3-3aef-45ab-bf7f-7a8c96bcf224 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-changed-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-baddeb1e-cbaf-4163-b11a-a0bdb746d399 req-9a4577b3-3aef-45ab-bf7f-7a8c96bcf224 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Refreshing instance network info cache due to event network-changed-cea7b68d-7124-4c01-94b1-73632f0c4000. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-baddeb1e-cbaf-4163-b11a-a0bdb746d399 req-9a4577b3-3aef-45ab-bf7f-7a8c96bcf224 service nova] Acquiring lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-baddeb1e-cbaf-4163-b11a-a0bdb746d399 req-9a4577b3-3aef-45ab-bf7f-7a8c96bcf224 service nova] Acquired lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-baddeb1e-cbaf-4163-b11a-a0bdb746d399 req-9a4577b3-3aef-45ab-bf7f-7a8c96bcf224 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Refreshing network info cache for port cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:11:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=6821MB free_disk=25.717639923095703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3fa19b27-7628-44ce-b0ae-e1e870337855 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 70390b89-fdfb-4552-98e5-35568c0268bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance d7bc97ea-3b81-488c-8c63-b83a351118d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 90188af1-901c-453f-b113-133b1e86bc85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 903e763a-6ec7-415a-8db9-c5330cd93aec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 9791d36b-9111-47c7-aa6d-c86645e1a453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 2f74fd47-e29b-4392-9af3-eabed0d91993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ff2064c1-e1bb-4abe-ab33-ced79efbeadc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 266431b4-b49b-4079-b5c7-c0f59f46d201 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-9437abcc-2fcb-4274-aef6-a980594877d3 req-b0bbdb07-5c1c-49de-ab56-ccf9b7dfa303 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-changed-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-9437abcc-2fcb-4274-aef6-a980594877d3 req-b0bbdb07-5c1c-49de-ab56-ccf9b7dfa303 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Refreshing instance network info cache due to event network-changed-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9437abcc-2fcb-4274-aef6-a980594877d3 req-b0bbdb07-5c1c-49de-ab56-ccf9b7dfa303 service nova] Acquiring lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9437abcc-2fcb-4274-aef6-a980594877d3 req-b0bbdb07-5c1c-49de-ab56-ccf9b7dfa303 service nova] Acquired lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-9437abcc-2fcb-4274-aef6-a980594877d3 req-b0bbdb07-5c1c-49de-ab56-ccf9b7dfa303 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Refreshing network info cache for port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.726s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updated VIF entry in instance network info cache for port 048cf7d9-d093-41eb-b546-a00c669a3dab. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:11:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [{"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-changed-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing instance network info cache due to event network-changed-368b421b-b98c-4fe9-919b-aa74db34f552. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing network info cache for port 368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-baddeb1e-cbaf-4163-b11a-a0bdb746d399 req-9a4577b3-3aef-45ab-bf7f-7a8c96bcf224 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updated VIF entry in instance network info cache for port cea7b68d-7124-4c01-94b1-73632f0c4000. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-baddeb1e-cbaf-4163-b11a-a0bdb746d399 req-9a4577b3-3aef-45ab-bf7f-7a8c96bcf224 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-baddeb1e-cbaf-4163-b11a-a0bdb746d399 req-9a4577b3-3aef-45ab-bf7f-7a8c96bcf224 service nova] Releasing lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:11:47 user nova-compute[74681]: INFO nova.compute.manager [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] instance snapshotting
Aug 16 06:11:47 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Beginning live snapshot process
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updated VIF entry in instance network info cache for port 368b421b-b98c-4fe9-919b-aa74db34f552. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [{"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b607be16-b606-42c8-9187-efd5971d53ff req-559b5be5-9e86-41e7-9f05-ae5ca57d6e96 service nova] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-9437abcc-2fcb-4274-aef6-a980594877d3 req-b0bbdb07-5c1c-49de-ab56-ccf9b7dfa303 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updated VIF entry in instance network info cache for port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-9437abcc-2fcb-4274-aef6-a980594877d3 req-b0bbdb07-5c1c-49de-ab56-ccf9b7dfa303 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9437abcc-2fcb-4274-aef6-a980594877d3 req-b0bbdb07-5c1c-49de-ab56-ccf9b7dfa303 service nova] Releasing lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json -f qcow2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json -f qcow2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp54rm6gji/61cc08df35ab4b4c8d9fd41d7b748f7b.delta 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp54rm6gji/61cc08df35ab4b4c8d9fd41d7b748f7b.delta 1073741824" returned: 0 in 0.053s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 06:11:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74681) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 06:11:48 user nova-compute[74681]: INFO nova.virt.libvirt.host [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] UEFI support detected
Aug 16 06:11:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:11:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:11:49 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 06:11:49 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:11:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp54rm6gji/61cc08df35ab4b4c8d9fd41d7b748f7b.delta /opt/stack/data/nova/instances/snapshots/tmp54rm6gji/61cc08df35ab4b4c8d9fd41d7b748f7b {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp54rm6gji/61cc08df35ab4b4c8d9fd41d7b748f7b.delta /opt/stack/data/nova/instances/snapshots/tmp54rm6gji/61cc08df35ab4b4c8d9fd41d7b748f7b" returned: 0 in 0.463s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:50 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Snapshot extracted, beginning image upload
Aug 16 06:11:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:50 user nova-compute[74681]: INFO nova.virt.block_device [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Booting with volume a0a9921b-dc75-4c9f-a3e4-a428f60d7035 at /dev/vdc
Aug 16 06:11:50 user nova-compute[74681]: DEBUG os_brick.utils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[321aa735-cbc0-4b64-86a9-c93995ca2de5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[286c3871-1fc8-4423-8186-1855216e9e42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ff44f5-2cac-42b2-8743-8b96fedf3f84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b1c4e-e103-4e9e-bd78-ec530cdee247]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:11:50 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:11:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1e9c49-e68d-4df3-843d-a0b2ffd1397c]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG os_brick.utils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:11:50 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating existing volume attachment record: 0d34a721-2f1c-4c59-9374-93a19bf09c23 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:11:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:52 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Snapshot image upload complete
Aug 16 06:11:52 user nova-compute[74681]: INFO nova.compute.manager [None req-a428f369-76b7-485c-ae6a-811339db1b5f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Took 5.46 seconds to snapshot the instance on the hypervisor.
Aug 16 06:11:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:54 user nova-compute[74681]: DEBUG os_brick.initiator.connector [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Factory for ISCSI on None {{(pid=74681) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 06:11:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:11:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heTQczMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:11:54 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:11:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:11:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:11:54 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:11:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:11:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:11:54 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:11:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260" returned: 21 in 0.115s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4195cd9b-81aa-474a-b97e-fb069e7af7c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:11:55 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4668b277-649a-47a3-9bc3-4759a2c96b00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1] added
Aug 16 06:11:55 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9afc422-7d47-4eb3-adbd-a34ee6913638]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d94ff6e-75a6-4f8d-9e1b-8c42cfd2facb]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heTQczMg {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heTQczMg" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eafb8c7-9655-4b15-9337-4e9ebead8a2c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heTQczMg'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ae13b5-eb02-4db0-9fb2-33d414db1172]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0a42fe-27be-47b3-beca-1d051d19134a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:11:55 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:11:55 user nova-compute[74681]:  {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:11:55 user nova-compute[74681]: WARNING os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 06:11:55 user nova-compute[74681]: 
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[46960497-c232-46f8-8a67-7313987f8a29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1, portal: 172.16.0.220,3260]
Aug 16 06:11:55 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1, portal: 172.16.0.220,3260] successful.
Aug 16 06:11:55 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ba79ba-b52f-4151-91d8-9b79dee6ba4d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[665e583b-9de6-4e8b-b469-1cdc697399da]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:11:55 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:11:55 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11e1d3-62d5-4ae7-b420-b8f31acded2e]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heTQczMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:11:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23566363361303761', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566363361303761', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 3fa19b27-7628-44ce-b0ae-e1e870337855 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:56 user nova-compute[74681]: INFO nova.compute.manager [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Shelving
Aug 16 06:11:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:11:56 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:11:56 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:11:56 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:11:56 user nova-compute[74681]:   <serial>2ceb578a-53e8-49b1-a5a7-512c5031efa1</serial>
Aug 16 06:11:56 user nova-compute[74681]: </disk>
Aug 16 06:11:56 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-48af7c1b-19e0-4b77-a9ed-c92feac22d2f req-d70675cf-9485-4246-96eb-0f132e01ee27 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-unplugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-48af7c1b-19e0-4b77-a9ed-c92feac22d2f req-d70675cf-9485-4246-96eb-0f132e01ee27 service nova] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-48af7c1b-19e0-4b77-a9ed-c92feac22d2f req-d70675cf-9485-4246-96eb-0f132e01ee27 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-48af7c1b-19e0-4b77-a9ed-c92feac22d2f req-d70675cf-9485-4246-96eb-0f132e01ee27 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-48af7c1b-19e0-4b77-a9ed-c92feac22d2f req-d70675cf-9485-4246-96eb-0f132e01ee27 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] No waiting events found dispatching network-vif-unplugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:11:57 user nova-compute[74681]: WARNING nova.compute.manager [req-48af7c1b-19e0-4b77-a9ed-c92feac22d2f req-d70675cf-9485-4246-96eb-0f132e01ee27 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received unexpected event network-vif-unplugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 for instance with vm_state active and task_state shelving.
Aug 16 06:11:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No VIF found with MAC fa:16:3e:ec:1c:19, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4bfea2db-46b1-4daa-9ac6-d3e74a013507 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.977s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance destroyed successfully.
Aug 16 06:11:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Beginning cold snapshot process
Aug 16 06:11:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:11:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk /opt/stack/data/nova/instances/snapshots/tmp_4w0zskl/ba4ff7dbdf6d42559b72b2d2fd35d486 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:11:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk /opt/stack/data/nova/instances/snapshots/tmp_4w0zskl/ba4ff7dbdf6d42559b72b2d2fd35d486" returned: 0 in 0.634s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:11:58 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Snapshot extracted, beginning image upload
Aug 16 06:11:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:11:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-87fead9c-592f-4321-9f33-825eafa5fea2 req-7fe7e7f9-57b4-4545-9b8e-5fc1768b0150 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:11:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-87fead9c-592f-4321-9f33-825eafa5fea2 req-7fe7e7f9-57b4-4545-9b8e-5fc1768b0150 service nova] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:11:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-87fead9c-592f-4321-9f33-825eafa5fea2 req-7fe7e7f9-57b4-4545-9b8e-5fc1768b0150 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:11:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-87fead9c-592f-4321-9f33-825eafa5fea2 req-7fe7e7f9-57b4-4545-9b8e-5fc1768b0150 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:11:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-87fead9c-592f-4321-9f33-825eafa5fea2 req-7fe7e7f9-57b4-4545-9b8e-5fc1768b0150 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] No waiting events found dispatching network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:11:59 user nova-compute[74681]: WARNING nova.compute.manager [req-87fead9c-592f-4321-9f33-825eafa5fea2 req-7fe7e7f9-57b4-4545-9b8e-5fc1768b0150 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received unexpected event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 06:12:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:00 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Snapshot image upload complete
Aug 16 06:12:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:00 user nova-compute[74681]: INFO nova.compute.manager [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Shelve offloading
Aug 16 06:12:00 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance destroyed successfully.
Aug 16 06:12:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquired lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "c3c07afb-5fb6-456d-a631-028e7c817b23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:12:01 user nova-compute[74681]: INFO nova.compute.claims [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Claim successful on node user
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.network.neutron [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-c65381b8-bac1-4daa-94e0-0629564ec6d0 req-e0112638-3a59-487a-be05-6f8a053be9e9 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received event network-changed-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-c65381b8-bac1-4daa-94e0-0629564ec6d0 req-e0112638-3a59-487a-be05-6f8a053be9e9 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Refreshing instance network info cache due to event network-changed-48ca2fee-705e-4726-8b71-1ddd30f158d4. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c65381b8-bac1-4daa-94e0-0629564ec6d0 req-e0112638-3a59-487a-be05-6f8a053be9e9 service nova] Acquiring lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c65381b8-bac1-4daa-94e0-0629564ec6d0 req-e0112638-3a59-487a-be05-6f8a053be9e9 service nova] Acquired lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.network.neutron [req-c65381b8-bac1-4daa-94e0-0629564ec6d0 req-e0112638-3a59-487a-be05-6f8a053be9e9 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Refreshing network info cache for port 48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Releasing lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.network.neutron [req-c65381b8-bac1-4daa-94e0-0629564ec6d0 req-e0112638-3a59-487a-be05-6f8a053be9e9 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updated VIF entry in instance network info cache for port 48ca2fee-705e-4726-8b71-1ddd30f158d4. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.network.neutron [req-c65381b8-bac1-4daa-94e0-0629564ec6d0 req-e0112638-3a59-487a-be05-6f8a053be9e9 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updating instance_info_cache with network_info: [{"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c65381b8-bac1-4daa-94e0-0629564ec6d0 req-e0112638-3a59-487a-be05-6f8a053be9e9 service nova] Releasing lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:12:01 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:12:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.policy [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de61ce701f0b41fdb80225fc0ff05fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c0bd15a5644f4f92453e4706aef46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:12:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Creating image(s)
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "/opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "/opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-f27303e7-8feb-4b2f-87d8-51a6f0951fa8 req-df08642d-bd7a-4cdb-b1e1-68e2d9e8c2a1 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-changed-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-f27303e7-8feb-4b2f-87d8-51a6f0951fa8 req-df08642d-bd7a-4cdb-b1e1-68e2d9e8c2a1 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Refreshing instance network info cache due to event network-changed-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f27303e7-8feb-4b2f-87d8-51a6f0951fa8 req-df08642d-bd7a-4cdb-b1e1-68e2d9e8c2a1 service nova] Acquiring lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f27303e7-8feb-4b2f-87d8-51a6f0951fa8 req-df08642d-bd7a-4cdb-b1e1-68e2d9e8c2a1 service nova] Acquired lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.network.neutron [req-f27303e7-8feb-4b2f-87d8-51a6f0951fa8 req-df08642d-bd7a-4cdb-b1e1-68e2d9e8c2a1 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Refreshing network info cache for port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:12:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance destroyed successfully.
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.objects.instance [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'resources' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1357676255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1357676255',id=5,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPP4WdnC3IitpPuXRh9DuNwOaenN+tFxMoPwQ4Jrt+KrAEDKAfk0EqNOL7twax4UQxFQ8J959+AlJCZYRuXMxHriC3b+6QPfAM5Prrzgi7p+Y1iarKTje/zmsuBCucm7aQ==',key_name='tempest-keypair-1915031990',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-uaxulgsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member',shelved_at='2023-08-16T06:12:00.775085',shelved_host='user',shelved_image_id='e6caf706-da80-464d-a284-61897af5e7e6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:11:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=90188af1-901c-453f-b113-133b1e86bc85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG os_vif [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca0bdeea-d3, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:02 user nova-compute[74681]: INFO os_vif [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3')
Aug 16 06:12:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Deleting instance files /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85_del
Aug 16 06:12:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Deletion of /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85_del complete
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.196s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:02 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Deleted allocations for instance 90188af1-901c-453f-b113-133b1e86bc85
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.197s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk 1073741824" returned: 0 in 0.057s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.objects.instance [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'numa_topology' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Successfully created port: 9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.network.neutron [req-f27303e7-8feb-4b2f-87d8-51a6f0951fa8 req-df08642d-bd7a-4cdb-b1e1-68e2d9e8c2a1 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updated VIF entry in instance network info cache for port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.network.neutron [req-f27303e7-8feb-4b2f-87d8-51a6f0951fa8 req-df08642d-bd7a-4cdb-b1e1-68e2d9e8c2a1 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:02 user nova-compute[74681]: INFO nova.virt.block_device [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Booting with volume b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 at /dev/vdc
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f27303e7-8feb-4b2f-87d8-51a6f0951fa8 req-df08642d-bd7a-4cdb-b1e1-68e2d9e8c2a1 service nova] Releasing lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG os_brick.utils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ce8884-9630-4f8d-8846-4a1995c65957]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5987fe62-91a9-4653-92fe-938028f72374]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Cannot resize image /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.objects.instance [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'migration_context' on Instance uuid c3c07afb-5fb6-456d-a631-028e7c817b23 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[08424e21-1ec7-4033-be81-dc309cc6b877]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77c047b-9916-439a-8f55-82ef80629ada]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Ensure instance console log exists: /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:03 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f065572-aedf-4fac-9762-76872ef11de3]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG os_brick.utils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating existing volume attachment record: 422eb2a6-dbd7-426d-9c8a-215da1769dd7 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-055dc7bd-ec10-40d8-b207-ae43562b8977 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.008s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Successfully updated port: 9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquired lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-84d6c78c-478f-489e-b74c-40dfa1ca1f3a req-2a6ace8c-6cf0-437e-b773-a9249332c394 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received event network-changed-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-84d6c78c-478f-489e-b74c-40dfa1ca1f3a req-2a6ace8c-6cf0-437e-b773-a9249332c394 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Refreshing instance network info cache due to event network-changed-9fea00bc-cee5-48a3-9054-a1d314875c80. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-84d6c78c-478f-489e-b74c-40dfa1ca1f3a req-2a6ace8c-6cf0-437e-b773-a9249332c394 service nova] Acquiring lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:12:03 user nova-compute[74681]: DEBUG nova.network.neutron [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Updating instance_info_cache with network_info: [{"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Releasing lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Instance network_info: |[{"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-84d6c78c-478f-489e-b74c-40dfa1ca1f3a req-2a6ace8c-6cf0-437e-b773-a9249332c394 service nova] Acquired lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.network.neutron [req-84d6c78c-478f-489e-b74c-40dfa1ca1f3a req-2a6ace8c-6cf0-437e-b773-a9249332c394 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Refreshing network info cache for port 9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Start _get_guest_xml network_info=[{"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:12:04 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:12:04 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-283614017',display_name='tempest-AttachVolumeNegativeTest-server-283614017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-283614017',id=14,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADo/76orKLVnZUZGrDmFQlznNYnoVMxsUE3yYyGg/1znTGDQ7tIgp4Ifc91mGU95ca/ltPX6ZJvl+Nibymbi/HCasbNclvZ8DiN8zK/jdbapRpmE2BlYN1ZyM/EEDy3ww==',key_name='tempest-keypair-906521259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-nukys89k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=c3c07afb-5fb6-456d-a631-028e7c817b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:51:6f,bridge_name='br-int',has_traffic_filtering=True,id=9fea00bc-cee5-48a3-9054-a1d314875c80,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fea00bc-ce') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.objects.instance [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'pci_devices' on Instance uuid c3c07afb-5fb6-456d-a631-028e7c817b23 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:12:04 user nova-compute[74681]:   <uuid>c3c07afb-5fb6-456d-a631-028e7c817b23</uuid>
Aug 16 06:12:04 user nova-compute[74681]:   <name>instance-0000000e</name>
Aug 16 06:12:04 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:12:04 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:12:04 user nova-compute[74681]:   <metadata>
Aug 16 06:12:04 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:04 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:12:04 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeNegativeTest-server-283614017</nova:name>
Aug 16 06:12:04 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:12:04</nova:creationTime>
Aug 16 06:12:04 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:12:04 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:12:04 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:12:04 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:12:04 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:04 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:04 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:12:04 user nova-compute[74681]:       <nova:owner>
Aug 16 06:12:04 user nova-compute[74681]:         <nova:user uuid="de61ce701f0b41fdb80225fc0ff05fac">tempest-AttachVolumeNegativeTest-1322537387-project-member</nova:user>
Aug 16 06:12:04 user nova-compute[74681]:         <nova:project uuid="74c0bd15a5644f4f92453e4706aef46d">tempest-AttachVolumeNegativeTest-1322537387</nova:project>
Aug 16 06:12:04 user nova-compute[74681]:       </nova:owner>
Aug 16 06:12:04 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:04 user nova-compute[74681]:       <nova:ports>
Aug 16 06:12:04 user nova-compute[74681]:         <nova:port uuid="9fea00bc-cee5-48a3-9054-a1d314875c80">
Aug 16 06:12:04 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:12:04 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:04 user nova-compute[74681]:       </nova:ports>
Aug 16 06:12:04 user nova-compute[74681]:     </nova:instance>
Aug 16 06:12:04 user nova-compute[74681]:   </metadata>
Aug 16 06:12:04 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:12:04 user nova-compute[74681]:     <system>
Aug 16 06:12:04 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:12:04 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:12:04 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:12:04 user nova-compute[74681]:       <entry name="serial">c3c07afb-5fb6-456d-a631-028e7c817b23</entry>
Aug 16 06:12:04 user nova-compute[74681]:       <entry name="uuid">c3c07afb-5fb6-456d-a631-028e7c817b23</entry>
Aug 16 06:12:04 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:12:04 user nova-compute[74681]:     </system>
Aug 16 06:12:04 user nova-compute[74681]:   </sysinfo>
Aug 16 06:12:04 user nova-compute[74681]:   <os>
Aug 16 06:12:04 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:12:04 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:12:04 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:12:04 user nova-compute[74681]:   </os>
Aug 16 06:12:04 user nova-compute[74681]:   <features>
Aug 16 06:12:04 user nova-compute[74681]:     <acpi/>
Aug 16 06:12:04 user nova-compute[74681]:     <apic/>
Aug 16 06:12:04 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:12:04 user nova-compute[74681]:   </features>
Aug 16 06:12:04 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:12:04 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:12:04 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:12:04 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:12:04 user nova-compute[74681]:   </clock>
Aug 16 06:12:04 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:12:04 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:12:04 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:12:04 user nova-compute[74681]:   </cpu>
Aug 16 06:12:04 user nova-compute[74681]:   <devices>
Aug 16 06:12:04 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:12:04 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:12:04 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk"/>
Aug 16 06:12:04 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:12:04 user nova-compute[74681]:     </disk>
Aug 16 06:12:04 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:04 user nova-compute[74681]:       <mac address="fa:16:3e:cd:51:6f"/>
Aug 16 06:12:04 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:04 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:04 user nova-compute[74681]:       <target dev="tap9fea00bc-ce"/>
Aug 16 06:12:04 user nova-compute[74681]:     </interface>
Aug 16 06:12:04 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:12:04 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/console.log" append="off"/>
Aug 16 06:12:04 user nova-compute[74681]:     </serial>
Aug 16 06:12:04 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:12:04 user nova-compute[74681]:     <video>
Aug 16 06:12:04 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:04 user nova-compute[74681]:     </video>
Aug 16 06:12:04 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:12:04 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:12:04 user nova-compute[74681]:     </rng>
Aug 16 06:12:04 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:12:04 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:12:04 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:12:04 user nova-compute[74681]:     </memballoon>
Aug 16 06:12:04 user nova-compute[74681]:   </devices>
Aug 16 06:12:04 user nova-compute[74681]: </domain>
Aug 16 06:12:04 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-283614017',display_name='tempest-AttachVolumeNegativeTest-server-283614017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-283614017',id=14,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADo/76orKLVnZUZGrDmFQlznNYnoVMxsUE3yYyGg/1znTGDQ7tIgp4Ifc91mGU95ca/ltPX6ZJvl+Nibymbi/HCasbNclvZ8DiN8zK/jdbapRpmE2BlYN1ZyM/EEDy3ww==',key_name='tempest-keypair-906521259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-nukys89k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=c3c07afb-5fb6-456d-a631-028e7c817b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:51:6f,bridge_name='br-int',has_traffic_filtering=True,id=9fea00bc-cee5-48a3-9054-a1d314875c80,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fea00bc-ce') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG os_vif [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:51:6f,bridge_name='br-int',has_traffic_filtering=True,id=9fea00bc-cee5-48a3-9054-a1d314875c80,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fea00bc-ce') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fea00bc-ce, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fea00bc-ce, col_values=(('external_ids', {'iface-id': '9fea00bc-cee5-48a3-9054-a1d314875c80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:51:6f', 'vm-uuid': 'c3c07afb-5fb6-456d-a631-028e7c817b23'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:04 user nova-compute[74681]: INFO os_vif [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:51:6f,bridge_name='br-int',has_traffic_filtering=True,id=9fea00bc-cee5-48a3-9054-a1d314875c80,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fea00bc-ce')
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No VIF found with MAC fa:16:3e:cd:51:6f, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.network.neutron [req-84d6c78c-478f-489e-b74c-40dfa1ca1f3a req-2a6ace8c-6cf0-437e-b773-a9249332c394 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Updated VIF entry in instance network info cache for port 9fea00bc-cee5-48a3-9054-a1d314875c80. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG nova.network.neutron [req-84d6c78c-478f-489e-b74c-40dfa1ca1f3a req-2a6ace8c-6cf0-437e-b773-a9249332c394 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Updating instance_info_cache with network_info: [{"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-84d6c78c-478f-489e-b74c-40dfa1ca1f3a req-2a6ace8c-6cf0-437e-b773-a9249332c394 service nova] Releasing lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'flavor' on Instance uuid 6fa74c3d-f621-4cf2-8763-6d75109fb113 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:05 user nova-compute[74681]: INFO nova.compute.manager [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Attaching volume ec814657-7ed7-43fb-ac22-37fa8aaca265 to /dev/vdb
Aug 16 06:12:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG os_brick.utils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[db52b5e4-f128-419f-93c9-781e81aef629]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0177df59-4870-456b-9ba3-b8fbfd683c4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ea055-c7e9-4447-8193-540f00558a1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0ed487-58fc-48b1-8bed-c29d0d1cea48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:05 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cac694-df38-46a2-b921-77ce2093ac90]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG os_brick.utils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updating existing volume attachment record: 55b8046c-ced7-40cd-b709-4471d15975d5 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-8e88f098-c83e-4343-90b2-d8aaee9b55da req-d5fee2e5-fc7e-4cd1-b2f2-9d558e47b010 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received event network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8e88f098-c83e-4343-90b2-d8aaee9b55da req-d5fee2e5-fc7e-4cd1-b2f2-9d558e47b010 service nova] Acquiring lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8e88f098-c83e-4343-90b2-d8aaee9b55da req-d5fee2e5-fc7e-4cd1-b2f2-9d558e47b010 service nova] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8e88f098-c83e-4343-90b2-d8aaee9b55da req-d5fee2e5-fc7e-4cd1-b2f2-9d558e47b010 service nova] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-8e88f098-c83e-4343-90b2-d8aaee9b55da req-d5fee2e5-fc7e-4cd1-b2f2-9d558e47b010 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] No waiting events found dispatching network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:05 user nova-compute[74681]: WARNING nova.compute.manager [req-8e88f098-c83e-4343-90b2-d8aaee9b55da req-d5fee2e5-fc7e-4cd1-b2f2-9d558e47b010 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received unexpected event network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 for instance with vm_state building and task_state spawning.
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166327.6153936, c3c07afb-5fb6-456d-a631-028e7c817b23 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:12:07 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] VM Resumed (Lifecycle Event)
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:12:07 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Instance spawned successfully.
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:07 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166327.6171668, c3c07afb-5fb6-456d-a631-028e7c817b23 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:12:07 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] VM Started (Lifecycle Event)
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:12:07 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:12:07 user nova-compute[74681]: INFO nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:07 user nova-compute[74681]: INFO nova.compute.manager [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Took 6.53 seconds to build instance.
Aug 16 06:12:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4c3047cf-b5f6-4800-8128-5e389cf52b7e tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.653s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-d4f4b96b-ecee-4b53-8ad9-49d52db2eba5 req-68f5e5c6-ccff-4060-8f47-d2f68ab04317 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received event network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d4f4b96b-ecee-4b53-8ad9-49d52db2eba5 req-68f5e5c6-ccff-4060-8f47-d2f68ab04317 service nova] Acquiring lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d4f4b96b-ecee-4b53-8ad9-49d52db2eba5 req-68f5e5c6-ccff-4060-8f47-d2f68ab04317 service nova] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d4f4b96b-ecee-4b53-8ad9-49d52db2eba5 req-68f5e5c6-ccff-4060-8f47-d2f68ab04317 service nova] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-d4f4b96b-ecee-4b53-8ad9-49d52db2eba5 req-68f5e5c6-ccff-4060-8f47-d2f68ab04317 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] No waiting events found dispatching network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:07 user nova-compute[74681]: WARNING nova.compute.manager [req-d4f4b96b-ecee-4b53-8ad9-49d52db2eba5 req-68f5e5c6-ccff-4060-8f47-d2f68ab04317 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received unexpected event network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 for instance with vm_state active and task_state None.
Aug 16 06:12:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:12:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Creating image(s)
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Ensure instance console log exists: /opt/stack/data/nova/instances/ff2064c1-e1bb-4abe-ab33-ced79efbeadc/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Start _get_guest_xml network_info=[{"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e61bd32b-520f-40a9-8411-705982fa927f', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdgsKyEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2dce38e-94a3-4add-83f4-8d153c6adad7', 'serial': 'd2dce38e-94a3-4add-83f4-8d153c6adad7'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '8599d49a-2614-4713-9792-54e12f27b64e', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRjSvcap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc', 'attached_at': '', 'detached_at': '', 'volume_id': '5047d252-a8d1-497c-b7f9-4e53b36ba767', 'serial': '5047d252-a8d1-497c-b7f9-4e53b36ba767'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '0d34a721-2f1c-4c59-9374-93a19bf09c23', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxYgOefU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0a9921b-dc75-4c9f-a3e4-a428f60d7035', 'serial': 'a0a9921b-dc75-4c9f-a3e4-a428f60d7035'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:12:10 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:12:10 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdgsKyEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:10 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:10 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:10 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a70b5-b3da-4481-9932-4a3224076e69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:10 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a52176-5eeb-4175-97e2-b73883999177]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7] added
Aug 16 06:12:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e99c13-55c6-4589-aa59-3213dbd0a880]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0e2741-5f9a-4b5f-bd98-8d8d369ffd8e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdgsKyEG {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VdgsKyEG" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[56327603-ae8d-4d69-9eb1-3ee8468f405a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VdgsKyEG'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49a3190-73db-44ba-8821-c378ef41a60a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42ac345-f798-4cc1-93f2-ba8d0ab060d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44c2349-5d65-4080-ae9c-141eafc2a9a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7, portal: 172.16.0.220,3260]
Aug 16 06:12:10 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[85393c95-dd67-43cc-acb0-cf67755ccaf4]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ba8868-df34-4f21-b788-3c54c6936cf8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:10 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:10 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f38e68-40b1-4ab6-b8d7-aab024f02e26]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdgsKyEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23732623938643738', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732623938643738', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRjSvcap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:11 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:11 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:11 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa6c50f-5d3e-460d-9490-82b5f39872a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:11 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[98de3f64-5275-4c12-b3ee-5bdb880342a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767] added
Aug 16 06:12:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04904a4-b73d-4de4-87c0-82c1f0689d45]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb26dfea-d482-4a5d-8af4-ec2b2bae2eb5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRjSvcap {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRjSvcap" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e234865-3bc1-48ec-b624-c1552197fe0c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nRjSvcap'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[653731a7-742d-42dd-87c9-425210f1cfa2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02cdcf4-9dd3-47ce-9d43-d4caa0971702]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:11 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:11 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6fb844-1a17-4bbd-b1d4-f8983b6555de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767, portal: 172.16.0.220,3260]
Aug 16 06:12:12 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a7d5e8-7781-44d5-bee3-ac5a43ad5fd3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f385771a-b89c-49b8-84ac-8cfde6a8423a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:12 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:12 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:12 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:12 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b8682-05e3-45c3-a109-3779046a699c]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRjSvcap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-78174f6a-8129-4022-855e-539b7eac7c95 req-fc9f18e0-c56c-4a30-bed1-f40c8aa4f8d0 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-changed-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-78174f6a-8129-4022-855e-539b7eac7c95 req-fc9f18e0-c56c-4a30-bed1-f40c8aa4f8d0 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Refreshing instance network info cache due to event network-changed-3627db91-9415-4563-b459-d2b461b3c470. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78174f6a-8129-4022-855e-539b7eac7c95 req-fc9f18e0-c56c-4a30-bed1-f40c8aa4f8d0 service nova] Acquiring lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78174f6a-8129-4022-855e-539b7eac7c95 req-fc9f18e0-c56c-4a30-bed1-f40c8aa4f8d0 service nova] Acquired lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG nova.network.neutron [req-78174f6a-8129-4022-855e-539b7eac7c95 req-fc9f18e0-c56c-4a30-bed1-f40c8aa4f8d0 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Refreshing network info cache for port 3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:12:12 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166317.5667017, 90188af1-901c-453f-b113-133b1e86bc85 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:12:12 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] VM Stopped (Lifecycle Event)
Aug 16 06:12:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0106f931-cead-4310-add5-e5ed5f3fe18e None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "interface-76acb01b-43fd-4a5b-990d-ee95e09aeeab-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "interface-76acb01b-43fd-4a5b-990d-ee95e09aeeab-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.objects.instance [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'flavor' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26665623762323030', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665623762323030', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxYgOefU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:13 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:13 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:13 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea576019-3b06-4c4b-be36-612d527b807b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:13 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8098279-c8ab-4a8a-bdbb-c7a86400667f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035] added
Aug 16 06:12:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f492e9d-7008-4bcc-a6b6-45abded19b7f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdb5308-5603-4dcb-9df6-57a90308c168]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxYgOefU {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxYgOefU" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6d5409-2f9a-4845-8cb7-4deb095d2ee2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bxYgOefU'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fddcaa4-d8b7-4b36-a8a8-716a0a98a159]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.network.neutron [req-78174f6a-8129-4022-855e-539b7eac7c95 req-fc9f18e0-c56c-4a30-bed1-f40c8aa4f8d0 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updated VIF entry in instance network info cache for port 3627db91-9415-4563-b459-d2b461b3c470. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.network.neutron [req-78174f6a-8129-4022-855e-539b7eac7c95 req-fc9f18e0-c56c-4a30-bed1-f40c8aa4f8d0 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e95ff-d2ca-47c8-8c11-3e06a15e28ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78174f6a-8129-4022-855e-539b7eac7c95 req-fc9f18e0-c56c-4a30-bed1-f40c8aa4f8d0 service nova] Releasing lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e71fdcc-26d3-4c37-aafd-9ea80946d719]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035, portal: 172.16.0.220,3260]
Aug 16 06:12:13 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7f7bb1-635f-4125-a11a-92f40f75c814]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b354d738-ce0a-4e37-a042-13fc58bebcb0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5399a66-8490-4563-a35b-caf73aea881e]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxYgOefU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-e50e5137-9aff-463b-9285-05e1b1bd7a14 req-76889cb0-affb-4e36-9716-7eb007360707 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received event network-changed-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-e50e5137-9aff-463b-9285-05e1b1bd7a14 req-76889cb0-affb-4e36-9716-7eb007360707 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Refreshing instance network info cache due to event network-changed-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e50e5137-9aff-463b-9285-05e1b1bd7a14 req-76889cb0-affb-4e36-9716-7eb007360707 service nova] Acquiring lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e50e5137-9aff-463b-9285-05e1b1bd7a14 req-76889cb0-affb-4e36-9716-7eb007360707 service nova] Acquired lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.network.neutron [req-e50e5137-9aff-463b-9285-05e1b1bd7a14 req-76889cb0-affb-4e36-9716-7eb007360707 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Refreshing network info cache for port c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.objects.instance [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'pci_requests' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:13 user nova-compute[74681]: DEBUG nova.network.neutron [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.policy [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9edd2fb688ff4a44b33af0ae3a358f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85a954b5814d46929acbbfbc993c73a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-5884ea26-2a7c-459e-b0bb-6dce415e160e req-35cf8aa3-2ef0-4d2f-9678-b9784bb161a1 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received event network-changed-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-5884ea26-2a7c-459e-b0bb-6dce415e160e req-35cf8aa3-2ef0-4d2f-9678-b9784bb161a1 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Refreshing instance network info cache due to event network-changed-f1a21da6-a59f-430a-8b0b-2d0ed16ac211. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5884ea26-2a7c-459e-b0bb-6dce415e160e req-35cf8aa3-2ef0-4d2f-9678-b9784bb161a1 service nova] Acquiring lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5884ea26-2a7c-459e-b0bb-6dce415e160e req-35cf8aa3-2ef0-4d2f-9678-b9784bb161a1 service nova] Acquired lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.neutron [req-5884ea26-2a7c-459e-b0bb-6dce415e160e req-35cf8aa3-2ef0-4d2f-9678-b9784bb161a1 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Refreshing network info cache for port f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23631356264336132', 'path': '/dev/sde'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631356264336132', 'path': '/dev/sde'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:71:60,bridge_name='br-int',has_traffic_filtering=True,id=b5f52a79-949a-4249-afc8-049040df17a1,network=Network(ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f52a79-94') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:68:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb1026fe-e425-441b-ad89-37e2d6e125de,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb1026fe-e4') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=c6d84664-b42d-4b02-a71a-17c3471e5bf3,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6d84664-b4') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:94,bridge_name='br-int',has_traffic_filtering=True,id=e9336b44-5798-4ac0-ae76-404bc96738a9,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9336b44-57') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:9c,bridge_name='br-int',has_traffic_filtering=True,id=59f6c45b-5dbf-43f3-936f-fd4280d13103,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6c45b-5d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:7b:ba,bridge_name='br-int',has_traffic_filtering=True,id=30bbb3b0-cdf3-46b3-b418-e908e295b5b2,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bbb3b0-cd') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:0b:4e,bridge_name='br-int',has_traffic_filtering=True,id=c1128321-8d72-4bd5-a749-65b9b6adb4ee,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1128321-8d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lazy-loading 'pci_devices' on Instance uuid ff2064c1-e1bb-4abe-ab33-ced79efbeadc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:12:14 user nova-compute[74681]:   <uuid>ff2064c1-e1bb-4abe-ab33-ced79efbeadc</uuid>
Aug 16 06:12:14 user nova-compute[74681]:   <name>instance-0000000b</name>
Aug 16 06:12:14 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:12:14 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:12:14 user nova-compute[74681]:   <metadata>
Aug 16 06:12:14 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:14 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:12:14 user nova-compute[74681]:       <nova:name>tempest-device-tagging-server-1296303401</nova:name>
Aug 16 06:12:14 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:12:10</nova:creationTime>
Aug 16 06:12:14 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:12:14 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:14 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:12:14 user nova-compute[74681]:       <nova:owner>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:user uuid="842f744ea91e4c12bc1bf04f725c5ed1">tempest-TaggedBootDevicesTest-1486639203-project-member</nova:user>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:project uuid="723ad3bf69ae47cd9c3b28f8b4174568">tempest-TaggedBootDevicesTest-1486639203</nova:project>
Aug 16 06:12:14 user nova-compute[74681]:       </nova:owner>
Aug 16 06:12:14 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:14 user nova-compute[74681]:       <nova:ports>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:port uuid="b5f52a79-949a-4249-afc8-049040df17a1">
Aug 16 06:12:14 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:12:14 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:port uuid="bb1026fe-e425-441b-ad89-37e2d6e125de">
Aug 16 06:12:14 user nova-compute[74681]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Aug 16 06:12:14 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:port uuid="c6d84664-b42d-4b02-a71a-17c3471e5bf3">
Aug 16 06:12:14 user nova-compute[74681]:           <nova:ip type="fixed" address="10.1.1.51" ipVersion="4"/>
Aug 16 06:12:14 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:port uuid="e9336b44-5798-4ac0-ae76-404bc96738a9">
Aug 16 06:12:14 user nova-compute[74681]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Aug 16 06:12:14 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:port uuid="59f6c45b-5dbf-43f3-936f-fd4280d13103">
Aug 16 06:12:14 user nova-compute[74681]:           <nova:ip type="fixed" address="10.1.1.43" ipVersion="4"/>
Aug 16 06:12:14 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:port uuid="30bbb3b0-cdf3-46b3-b418-e908e295b5b2">
Aug 16 06:12:14 user nova-compute[74681]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 06:12:14 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:14 user nova-compute[74681]:         <nova:port uuid="c1128321-8d72-4bd5-a749-65b9b6adb4ee">
Aug 16 06:12:14 user nova-compute[74681]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 06:12:14 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:14 user nova-compute[74681]:       </nova:ports>
Aug 16 06:12:14 user nova-compute[74681]:     </nova:instance>
Aug 16 06:12:14 user nova-compute[74681]:   </metadata>
Aug 16 06:12:14 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:12:14 user nova-compute[74681]:     <system>
Aug 16 06:12:14 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:12:14 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:12:14 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:12:14 user nova-compute[74681]:       <entry name="serial">ff2064c1-e1bb-4abe-ab33-ced79efbeadc</entry>
Aug 16 06:12:14 user nova-compute[74681]:       <entry name="uuid">ff2064c1-e1bb-4abe-ab33-ced79efbeadc</entry>
Aug 16 06:12:14 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:12:14 user nova-compute[74681]:     </system>
Aug 16 06:12:14 user nova-compute[74681]:   </sysinfo>
Aug 16 06:12:14 user nova-compute[74681]:   <os>
Aug 16 06:12:14 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:12:14 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:12:14 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:12:14 user nova-compute[74681]:   </os>
Aug 16 06:12:14 user nova-compute[74681]:   <features>
Aug 16 06:12:14 user nova-compute[74681]:     <acpi/>
Aug 16 06:12:14 user nova-compute[74681]:     <apic/>
Aug 16 06:12:14 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:12:14 user nova-compute[74681]:   </features>
Aug 16 06:12:14 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:12:14 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:12:14 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:12:14 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:12:14 user nova-compute[74681]:   </clock>
Aug 16 06:12:14 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:12:14 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:12:14 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:12:14 user nova-compute[74681]:   </cpu>
Aug 16 06:12:14 user nova-compute[74681]:   <devices>
Aug 16 06:12:14 user nova-compute[74681]:     <disk type="file" device="cdrom">
Aug 16 06:12:14 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 06:12:14 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/ff2064c1-e1bb-4abe-ab33-ced79efbeadc/disk.config"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="hda" bus="ide"/>
Aug 16 06:12:14 user nova-compute[74681]:     </disk>
Aug 16 06:12:14 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:12:14 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:14 user nova-compute[74681]:       <source dev="/dev/sdc"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <serial>d2dce38e-94a3-4add-83f4-8d153c6adad7</serial>
Aug 16 06:12:14 user nova-compute[74681]:     </disk>
Aug 16 06:12:14 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:12:14 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:14 user nova-compute[74681]:       <source dev="/dev/sdd"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <serial>5047d252-a8d1-497c-b7f9-4e53b36ba767</serial>
Aug 16 06:12:14 user nova-compute[74681]:     </disk>
Aug 16 06:12:14 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:12:14 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:14 user nova-compute[74681]:       <source dev="/dev/sde"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="vdc" bus="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <serial>a0a9921b-dc75-4c9f-a3e4-a428f60d7035</serial>
Aug 16 06:12:14 user nova-compute[74681]:     </disk>
Aug 16 06:12:14 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:14 user nova-compute[74681]:       <mac address="fa:16:3e:48:71:60"/>
Aug 16 06:12:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="tapb5f52a79-94"/>
Aug 16 06:12:14 user nova-compute[74681]:     </interface>
Aug 16 06:12:14 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:14 user nova-compute[74681]:       <mac address="fa:16:3e:40:68:dd"/>
Aug 16 06:12:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="tapbb1026fe-e4"/>
Aug 16 06:12:14 user nova-compute[74681]:     </interface>
Aug 16 06:12:14 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:14 user nova-compute[74681]:       <mac address="fa:16:3e:49:b7:23"/>
Aug 16 06:12:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="tapc6d84664-b4"/>
Aug 16 06:12:14 user nova-compute[74681]:     </interface>
Aug 16 06:12:14 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:14 user nova-compute[74681]:       <mac address="fa:16:3e:f5:e2:94"/>
Aug 16 06:12:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="tape9336b44-57"/>
Aug 16 06:12:14 user nova-compute[74681]:     </interface>
Aug 16 06:12:14 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:14 user nova-compute[74681]:       <mac address="fa:16:3e:5d:13:9c"/>
Aug 16 06:12:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="tap59f6c45b-5d"/>
Aug 16 06:12:14 user nova-compute[74681]:     </interface>
Aug 16 06:12:14 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:14 user nova-compute[74681]:       <mac address="fa:16:3e:de:7b:ba"/>
Aug 16 06:12:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="tap30bbb3b0-cd"/>
Aug 16 06:12:14 user nova-compute[74681]:     </interface>
Aug 16 06:12:14 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:14 user nova-compute[74681]:       <mac address="fa:16:3e:2a:0b:4e"/>
Aug 16 06:12:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:14 user nova-compute[74681]:       <target dev="tapc1128321-8d"/>
Aug 16 06:12:14 user nova-compute[74681]:     </interface>
Aug 16 06:12:14 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:12:14 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/ff2064c1-e1bb-4abe-ab33-ced79efbeadc/console.log" append="off"/>
Aug 16 06:12:14 user nova-compute[74681]:     </serial>
Aug 16 06:12:14 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:12:14 user nova-compute[74681]:     <video>
Aug 16 06:12:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:14 user nova-compute[74681]:     </video>
Aug 16 06:12:14 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:12:14 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:12:14 user nova-compute[74681]:     </rng>
Aug 16 06:12:14 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:12:14 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:12:14 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:12:14 user nova-compute[74681]:     </memballoon>
Aug 16 06:12:14 user nova-compute[74681]:   </devices>
Aug 16 06:12:14 user nova-compute[74681]: </domain>
Aug 16 06:12:14 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:71:60,bridge_name='br-int',has_traffic_filtering=True,id=b5f52a79-949a-4249-afc8-049040df17a1,network=Network(ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f52a79-94') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:71:60,bridge_name='br-int',has_traffic_filtering=True,id=b5f52a79-949a-4249-afc8-049040df17a1,network=Network(ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f52a79-94') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lazy-loading 'flavor' on Instance uuid 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f52a79-94, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5f52a79-94, col_values=(('external_ids', {'iface-id': 'b5f52a79-949a-4249-afc8-049040df17a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:71:60', 'vm-uuid': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: INFO os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:71:60,bridge_name='br-int',has_traffic_filtering=True,id=b5f52a79-949a-4249-afc8-049040df17a1,network=Network(ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f52a79-94')
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:68:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb1026fe-e425-441b-ad89-37e2d6e125de,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb1026fe-e4') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:68:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb1026fe-e425-441b-ad89-37e2d6e125de,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb1026fe-e4') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb1026fe-e4, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb1026fe-e4, col_values=(('external_ids', {'iface-id': 'bb1026fe-e425-441b-ad89-37e2d6e125de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:68:dd', 'vm-uuid': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: INFO os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:68:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb1026fe-e425-441b-ad89-37e2d6e125de,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb1026fe-e4')
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=c6d84664-b42d-4b02-a71a-17c3471e5bf3,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6d84664-b4') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=c6d84664-b42d-4b02-a71a-17c3471e5bf3,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6d84664-b4') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6d84664-b4, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6d84664-b4, col_values=(('external_ids', {'iface-id': 'c6d84664-b42d-4b02-a71a-17c3471e5bf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:b7:23', 'vm-uuid': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: INFO os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=c6d84664-b42d-4b02-a71a-17c3471e5bf3,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6d84664-b4')
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:94,bridge_name='br-int',has_traffic_filtering=True,id=e9336b44-5798-4ac0-ae76-404bc96738a9,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9336b44-57') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:94,bridge_name='br-int',has_traffic_filtering=True,id=e9336b44-5798-4ac0-ae76-404bc96738a9,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9336b44-57') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9336b44-57, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9336b44-57, col_values=(('external_ids', {'iface-id': 'e9336b44-5798-4ac0-ae76-404bc96738a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:e2:94', 'vm-uuid': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.neutron [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Successfully created port: ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: INFO os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:94,bridge_name='br-int',has_traffic_filtering=True,id=e9336b44-5798-4ac0-ae76-404bc96738a9,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9336b44-57')
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:9c,bridge_name='br-int',has_traffic_filtering=True,id=59f6c45b-5dbf-43f3-936f-fd4280d13103,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6c45b-5d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:9c,bridge_name='br-int',has_traffic_filtering=True,id=59f6c45b-5dbf-43f3-936f-fd4280d13103,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6c45b-5d') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59f6c45b-5d, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59f6c45b-5d, col_values=(('external_ids', {'iface-id': '59f6c45b-5dbf-43f3-936f-fd4280d13103', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:13:9c', 'vm-uuid': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: INFO os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:9c,bridge_name='br-int',has_traffic_filtering=True,id=59f6c45b-5dbf-43f3-936f-fd4280d13103,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6c45b-5d')
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:7b:ba,bridge_name='br-int',has_traffic_filtering=True,id=30bbb3b0-cdf3-46b3-b418-e908e295b5b2,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bbb3b0-cd') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7b:ba,bridge_name='br-int',has_traffic_filtering=True,id=30bbb3b0-cdf3-46b3-b418-e908e295b5b2,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bbb3b0-cd') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30bbb3b0-cd, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30bbb3b0-cd, col_values=(('external_ids', {'iface-id': '30bbb3b0-cdf3-46b3-b418-e908e295b5b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:7b:ba', 'vm-uuid': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:15 user nova-compute[74681]: INFO nova.compute.manager [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Attaching volume beea31e9-502c-4616-ae6a-7781574bbbbc to /dev/vdb
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.network.neutron [req-e50e5137-9aff-463b-9285-05e1b1bd7a14 req-76889cb0-affb-4e36-9716-7eb007360707 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Updated VIF entry in instance network info cache for port c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.network.neutron [req-e50e5137-9aff-463b-9285-05e1b1bd7a14 req-76889cb0-affb-4e36-9716-7eb007360707 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Updating instance_info_cache with network_info: [{"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: INFO os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7b:ba,bridge_name='br-int',has_traffic_filtering=True,id=30bbb3b0-cdf3-46b3-b418-e908e295b5b2,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bbb3b0-cd')
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:0b:4e,bridge_name='br-int',has_traffic_filtering=True,id=c1128321-8d72-4bd5-a749-65b9b6adb4ee,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1128321-8d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:0b:4e,bridge_name='br-int',has_traffic_filtering=True,id=c1128321-8d72-4bd5-a749-65b9b6adb4ee,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1128321-8d') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e50e5137-9aff-463b-9285-05e1b1bd7a14 req-76889cb0-affb-4e36-9716-7eb007360707 service nova] Releasing lock "refresh_cache-903e763a-6ec7-415a-8db9-c5330cd93aec" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1128321-8d, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1128321-8d, col_values=(('external_ids', {'iface-id': 'c1128321-8d72-4bd5-a749-65b9b6adb4ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:0b:4e', 'vm-uuid': 'ff2064c1-e1bb-4abe-ab33-ced79efbeadc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: INFO os_vif [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:0b:4e,bridge_name='br-int',has_traffic_filtering=True,id=c1128321-8d72-4bd5-a749-65b9b6adb4ee,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1128321-8d')
Aug 16 06:12:15 user nova-compute[74681]: DEBUG os_brick.utils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b393b5-14f4-4845-90ce-d16b52ccf758]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2c1dc6-5bda-4f46-8e98-d3aea54fd2c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0bc3ee-cdc1-440e-bcd3-281b066cc0a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ce54f-fe6e-4c68-815b-241605849235]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] No BDM found with device name hda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] No VIF found with MAC fa:16:3e:48:71:60, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] No VIF found with MAC fa:16:3e:5d:13:9c, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Using config drive
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:15 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[17187320-d195-4649-8ac1-dd2a21175ee1]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG os_brick.utils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Updating existing volume attachment record: 0eb84f16-17e8-448d-a0a3-99ad7e248fd3 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:12:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Creating config drive at /opt/stack/data/nova/instances/ff2064c1-e1bb-4abe-ab33-ced79efbeadc/disk.config
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff2064c1-e1bb-4abe-ab33-ced79efbeadc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpof4wawjy {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff2064c1-e1bb-4abe-ab33-ced79efbeadc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpof4wawjy" returned: 0 in 0.077s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-5884ea26-2a7c-459e-b0bb-6dce415e160e req-35cf8aa3-2ef0-4d2f-9678-b9784bb161a1 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Updated VIF entry in instance network info cache for port f1a21da6-a59f-430a-8b0b-2d0ed16ac211. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-5884ea26-2a7c-459e-b0bb-6dce415e160e req-35cf8aa3-2ef0-4d2f-9678-b9784bb161a1 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Updating instance_info_cache with network_info: [{"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5884ea26-2a7c-459e-b0bb-6dce415e160e req-35cf8aa3-2ef0-4d2f-9678-b9784bb161a1 service nova] Releasing lock "refresh_cache-9791d36b-9111-47c7-aa6d-c86645e1a453" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG nova.network.neutron [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Successfully updated port: ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquired lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG nova.network.neutron [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-a7429612-6763-49c0-a701-1e947692a87d req-0b0cfc56-e5c2-4ab1-9a9b-58a5ae1040b3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-changed-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-a7429612-6763-49c0-a701-1e947692a87d req-0b0cfc56-e5c2-4ab1-9a9b-58a5ae1040b3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Refreshing instance network info cache due to event network-changed-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:12:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a7429612-6763-49c0-a701-1e947692a87d req-0b0cfc56-e5c2-4ab1-9a9b-58a5ae1040b3 service nova] Acquiring lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-4631c899-bcad-497c-a1c1-7ca3de3fb877 req-c2bd70aa-795e-4f41-8930-aeaa2dd3e5f8 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received event network-changed-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-4631c899-bcad-497c-a1c1-7ca3de3fb877 req-c2bd70aa-795e-4f41-8930-aeaa2dd3e5f8 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Refreshing instance network info cache due to event network-changed-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4631c899-bcad-497c-a1c1-7ca3de3fb877 req-c2bd70aa-795e-4f41-8930-aeaa2dd3e5f8 service nova] Acquiring lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4631c899-bcad-497c-a1c1-7ca3de3fb877 req-c2bd70aa-795e-4f41-8930-aeaa2dd3e5f8 service nova] Acquired lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG nova.network.neutron [req-4631c899-bcad-497c-a1c1-7ca3de3fb877 req-c2bd70aa-795e-4f41-8930-aeaa2dd3e5f8 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Refreshing network info cache for port f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-2f7f054e-7f73-42d4-8aa9-2ce6ecab5a28 req-f42f9f9c-8ff8-4109-bb95-eb992401280d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2f7f054e-7f73-42d4-8aa9-2ce6ecab5a28 req-f42f9f9c-8ff8-4109-bb95-eb992401280d service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2f7f054e-7f73-42d4-8aa9-2ce6ecab5a28 req-f42f9f9c-8ff8-4109-bb95-eb992401280d service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2f7f054e-7f73-42d4-8aa9-2ce6ecab5a28 req-f42f9f9c-8ff8-4109-bb95-eb992401280d service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-2f7f054e-7f73-42d4-8aa9-2ce6ecab5a28 req-f42f9f9c-8ff8-4109-bb95-eb992401280d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:17 user nova-compute[74681]: WARNING nova.compute.manager [req-2f7f054e-7f73-42d4-8aa9-2ce6ecab5a28 req-f42f9f9c-8ff8-4109-bb95-eb992401280d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 for instance with vm_state building and task_state spawning.
Aug 16 06:12:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHPnBKbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:18 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:18 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:18 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb681536-a6cb-4c23-a9f7-bf7ebe321c1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:18 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9589e63c-13ad-4863-bbe1-c8e4c9fdb514]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265] added
Aug 16 06:12:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f43336-dfe2-474e-8fe6-b04179c40f22]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.048s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e849191-998c-417e-ab6a-5e428b7b68bf]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHPnBKbm {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHPnBKbm" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b4b117-0ccb-454e-bb3f-611b3b5e4ebd]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHPnBKbm'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cf5f23-4614-4904-8f64-df4a876e1189]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0a2c0d-d2df-44b2-819b-7f978ac07311]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.network.neutron [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lazy-loading 'flavor' on Instance uuid 2f74fd47-e29b-4392-9af3-eabed0d91993 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Releasing lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a7429612-6763-49c0-a701-1e947692a87d req-0b0cfc56-e5c2-4ab1-9a9b-58a5ae1040b3 service nova] Acquired lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.network.neutron [req-a7429612-6763-49c0-a701-1e947692a87d req-0b0cfc56-e5c2-4ab1-9a9b-58a5ae1040b3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Refreshing network info cache for port ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converting VIF {"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_vif [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[84442514-2864-4e98-93b2-05c8d4c53a0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265, portal: 172.16.0.220,3260]
Aug 16 06:12:18 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae0ec7db-8f, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae0ec7db-8f, col_values=(('external_ids', {'iface-id': 'ae0ec7db-8f6a-4c15-8d97-29ce173e57b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:d5:4f', 'vm-uuid': '76acb01b-43fd-4a5b-990d-ee95e09aeeab'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12cbea0-f6c0-4174-934a-280f0aabda5b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[213dfeb3-127c-4c5b-badd-31cf60f57171]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.454s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:18 user nova-compute[74681]: INFO os_vif [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f')
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converting VIF {"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.187s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] attach device xml: <interface type="ethernet">
Aug 16 06:12:18 user nova-compute[74681]:   <mac address="fa:16:3e:57:d5:4f"/>
Aug 16 06:12:18 user nova-compute[74681]:   <model type="virtio"/>
Aug 16 06:12:18 user nova-compute[74681]:   <mtu size="1442"/>
Aug 16 06:12:18 user nova-compute[74681]:   <target dev="tapae0ec7db-8f"/>
Aug 16 06:12:18 user nova-compute[74681]: </interface>
Aug 16 06:12:18 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.038s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b04cf-51ee-4183-bcc2-c1331977c8fa]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHPnBKbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-3a3249a9-45b9-40b6-84dc-d24a46aea24f req-dc46b5f8-493f-4b93-b518-32256e1c78e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3a3249a9-45b9-40b6-84dc-d24a46aea24f req-dc46b5f8-493f-4b93-b518-32256e1c78e8 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3a3249a9-45b9-40b6-84dc-d24a46aea24f req-dc46b5f8-493f-4b93-b518-32256e1c78e8 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3a3249a9-45b9-40b6-84dc-d24a46aea24f req-dc46b5f8-493f-4b93-b518-32256e1c78e8 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-3a3249a9-45b9-40b6-84dc-d24a46aea24f req-dc46b5f8-493f-4b93-b518-32256e1c78e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:18 user nova-compute[74681]: WARNING nova.compute.manager [req-3a3249a9-45b9-40b6-84dc-d24a46aea24f req-dc46b5f8-493f-4b93-b518-32256e1c78e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de for instance with vm_state building and task_state spawning.
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:18 user nova-compute[74681]: INFO nova.compute.manager [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Attaching volume b092283a-adfd-4f0e-ba34-8a0c682a55e3 to /dev/vdb
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG os_brick.utils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.network.neutron [req-4631c899-bcad-497c-a1c1-7ca3de3fb877 req-c2bd70aa-795e-4f41-8930-aeaa2dd3e5f8 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Updated VIF entry in instance network info cache for port f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.network.neutron [req-4631c899-bcad-497c-a1c1-7ca3de3fb877 req-c2bd70aa-795e-4f41-8930-aeaa2dd3e5f8 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Updating instance_info_cache with network_info: [{"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1a3f0f-daea-42fc-9416-1c50cf31b403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.038s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df174e4-1bb1-45b4-ab63-829624ac22ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4631c899-bcad-497c-a1c1-7ca3de3fb877 req-c2bd70aa-795e-4f41-8930-aeaa2dd3e5f8 service nova] Releasing lock "refresh_cache-2f74fd47-e29b-4392-9af3-eabed0d91993" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6425db4a-d4cb-456c-a8da-3e9d8e6e22ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca998d1-c8c6-46a6-9857-3e4c4e4c24d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-7c97140c-c627-4edc-ac45-d508c0d5badf req-bc922379-301e-4501-9579-75a77a0188fa service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7c97140c-c627-4edc-ac45-d508c0d5badf req-bc922379-301e-4501-9579-75a77a0188fa service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7c97140c-c627-4edc-ac45-d508c0d5badf req-bc922379-301e-4501-9579-75a77a0188fa service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7c97140c-c627-4edc-ac45-d508c0d5badf req-bc922379-301e-4501-9579-75a77a0188fa service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-7c97140c-c627-4edc-ac45-d508c0d5badf req-bc922379-301e-4501-9579-75a77a0188fa service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:19 user nova-compute[74681]: WARNING nova.compute.manager [req-7c97140c-c627-4edc-ac45-d508c0d5badf req-bc922379-301e-4501-9579-75a77a0188fa service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 for instance with vm_state building and task_state spawning.
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:19 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d0281-4b5f-4e1b-a87c-2cf6258ff2f7]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG os_brick.utils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Updating existing volume attachment record: ae126eee-2e7e-47f9-b75e-9f5c06173540 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.network.neutron [req-a7429612-6763-49c0-a701-1e947692a87d req-0b0cfc56-e5c2-4ab1-9a9b-58a5ae1040b3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updated VIF entry in instance network info cache for port ae0ec7db-8f6a-4c15-8d97-29ce173e57b7. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.network.neutron [req-a7429612-6763-49c0-a701-1e947692a87d req-0b0cfc56-e5c2-4ab1-9a9b-58a5ae1040b3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a7429612-6763-49c0-a701-1e947692a87d req-0b0cfc56-e5c2-4ab1-9a9b-58a5ae1040b3 service nova] Releasing lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No BDM found with device name hda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No VIF found with MAC fa:16:3e:b1:d3:83, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:19 user nova-compute[74681]:   <nova:package version="0.0.0"/>
Aug 16 06:12:19 user nova-compute[74681]:   <nova:name>tempest-device-tagging-server-1139632821</nova:name>
Aug 16 06:12:19 user nova-compute[74681]:   <nova:creationTime>2023-08-16 06:12:19</nova:creationTime>
Aug 16 06:12:19 user nova-compute[74681]:   <nova:flavor name="m1.tiny">
Aug 16 06:12:19 user nova-compute[74681]:     <nova:memory>512</nova:memory>
Aug 16 06:12:19 user nova-compute[74681]:     <nova:disk>1</nova:disk>
Aug 16 06:12:19 user nova-compute[74681]:     <nova:swap>0</nova:swap>
Aug 16 06:12:19 user nova-compute[74681]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:19 user nova-compute[74681]:     <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:19 user nova-compute[74681]:   </nova:flavor>
Aug 16 06:12:19 user nova-compute[74681]:   <nova:owner>
Aug 16 06:12:19 user nova-compute[74681]:     <nova:user uuid="9edd2fb688ff4a44b33af0ae3a358f53">tempest-TaggedAttachmentsTest-1137660729-project-member</nova:user>
Aug 16 06:12:19 user nova-compute[74681]:     <nova:project uuid="85a954b5814d46929acbbfbc993c73a3">tempest-TaggedAttachmentsTest-1137660729</nova:project>
Aug 16 06:12:19 user nova-compute[74681]:   </nova:owner>
Aug 16 06:12:19 user nova-compute[74681]:   <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:19 user nova-compute[74681]:   <nova:ports>
Aug 16 06:12:19 user nova-compute[74681]:     <nova:port uuid="3627db91-9415-4563-b459-d2b461b3c470">
Aug 16 06:12:19 user nova-compute[74681]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:12:19 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:19 user nova-compute[74681]:     <nova:port uuid="ae0ec7db-8f6a-4c15-8d97-29ce173e57b7">
Aug 16 06:12:19 user nova-compute[74681]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Aug 16 06:12:19 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:19 user nova-compute[74681]:   </nova:ports>
Aug 16 06:12:19 user nova-compute[74681]: </nova:instance>
Aug 16 06:12:19 user nova-compute[74681]:  {{(pid=74681) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.557s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] <== connect_volume: return (1559ms) {'type': 'block', 'scsi_wwn': '23738323830333234', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738323830333234', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'flavor' on Instance uuid 6fa74c3d-f621-4cf2-8763-6d75109fb113 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-67956c4f-7df7-4b36-93b9-e3f26eb1cbf2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "interface-76acb01b-43fd-4a5b-990d-ee95e09aeeab-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 6.508s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:12:19 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:19 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:19 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:19 user nova-compute[74681]:   <serial>ec814657-7ed7-43fb-ac22-37fa8aaca265</serial>
Aug 16 06:12:19 user nova-compute[74681]: </disk>
Aug 16 06:12:19 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-ff2e2f3a-cb49-4307-91f8-ba51f2f46dc6 req-2bbd88a3-f8aa-471e-93ab-b691619e8341 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ff2e2f3a-cb49-4307-91f8-ba51f2f46dc6 req-2bbd88a3-f8aa-471e-93ab-b691619e8341 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ff2e2f3a-cb49-4307-91f8-ba51f2f46dc6 req-2bbd88a3-f8aa-471e-93ab-b691619e8341 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ff2e2f3a-cb49-4307-91f8-ba51f2f46dc6 req-2bbd88a3-f8aa-471e-93ab-b691619e8341 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-ff2e2f3a-cb49-4307-91f8-ba51f2f46dc6 req-2bbd88a3-f8aa-471e-93ab-b691619e8341 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:20 user nova-compute[74681]: WARNING nova.compute.manager [req-ff2e2f3a-cb49-4307-91f8-ba51f2f46dc6 req-2bbd88a3-f8aa-471e-93ab-b691619e8341 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 for instance with vm_state building and task_state spawning.
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] No VIF found with MAC fa:16:3e:f2:7a:64, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:20 user nova-compute[74681]: WARNING nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de for instance with vm_state building and task_state spawning.
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:20 user nova-compute[74681]: WARNING nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 for instance with vm_state building and task_state spawning.
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:20 user nova-compute[74681]: WARNING nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 for instance with vm_state building and task_state spawning.
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:20 user nova-compute[74681]: WARNING nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 for instance with vm_state building and task_state spawning.
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:20 user nova-compute[74681]: WARNING nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 for instance with vm_state building and task_state spawning.
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:20 user nova-compute[74681]: WARNING nova.compute.manager [req-be3bbd4a-16e3-4dc6-8a51-ad8db079c3bf req-7d70a2c3-8065-4cd9-98ba-df7a36a45736 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee for instance with vm_state building and task_state spawning.
Aug 16 06:12:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:21 user nova-compute[74681]: WARNING nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 for instance with vm_state building and task_state spawning.
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:21 user nova-compute[74681]: WARNING nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 for instance with vm_state building and task_state spawning.
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:21 user nova-compute[74681]: WARNING nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 for instance with vm_state building and task_state spawning.
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] No waiting events found dispatching network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:21 user nova-compute[74681]: WARNING nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received unexpected event network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 for instance with vm_state active and task_state None.
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] No waiting events found dispatching network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:21 user nova-compute[74681]: WARNING nova.compute.manager [req-1ba89c60-58d5-4a47-b0b1-95431dc49412 req-ba8e165d-2911-444b-a644-b738e91c3ae9 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received unexpected event network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 for instance with vm_state active and task_state None.
Aug 16 06:12:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-7167dd68-8060-410b-a55b-9117453cd922 req-1cf6c051-32fa-40d8-8a17-03d41abcb752 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7167dd68-8060-410b-a55b-9117453cd922 req-1cf6c051-32fa-40d8-8a17-03d41abcb752 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7167dd68-8060-410b-a55b-9117453cd922 req-1cf6c051-32fa-40d8-8a17-03d41abcb752 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7167dd68-8060-410b-a55b-9117453cd922 req-1cf6c051-32fa-40d8-8a17-03d41abcb752 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-7167dd68-8060-410b-a55b-9117453cd922 req-1cf6c051-32fa-40d8-8a17-03d41abcb752 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:22 user nova-compute[74681]: WARNING nova.compute.manager [req-7167dd68-8060-410b-a55b-9117453cd922 req-1cf6c051-32fa-40d8-8a17-03d41abcb752 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee for instance with vm_state building and task_state spawning.
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166343.003709, ff2064c1-e1bb-4abe-ab33-ced79efbeadc => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] VM Resumed (Lifecycle Event)
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance spawned successfully.
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166343.0051384, ff2064c1-e1bb-4abe-ab33-ced79efbeadc => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] VM Started (Lifecycle Event)
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Took 12.89 seconds to spawn the instance on the hypervisor.
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.compute.manager [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Took 64.62 seconds to build instance.
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.objects.instance [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'flavor' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cac475cc-8403-4076-91ea-5e4fb9b311c6 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 64.739s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ec8c1854-c6d4-47e4-a03a-28a949245eef tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.769s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lazy-loading 'flavor' on Instance uuid 903e763a-6ec7-415a-8db9-c5330cd93aec {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Creating image(s)
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Ensure instance console log exists: /opt/stack/data/nova/instances/3a31765d-c4f1-40f6-b63d-ed0830d4bed4/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Start _get_guest_xml network_info=[{"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'b7c48330-e6fa-42b1-bfd0-2c42509459b2', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pANQtHim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4b86c91-e1b5-4e3f-8c24-12d92e6b899d', 'serial': 'f4b86c91-e1b5-4e3f-8c24-12d92e6b899d'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': 'b9e0aa04-577c-4379-971f-4c9bbd50ba55', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GubHvVrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb087afb-be48-4a76-92a5-46940f01d7ce', 'serial': 'fb087afb-be48-4a76-92a5-46940f01d7ce'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '422eb2a6-dbd7-426d-9c8a-215da1769dd7', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRBHbPQs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1a00e52-852a-4e4b-a35e-cb37c85ba7f7', 'serial': 'b1a00e52-852a-4e4b-a35e-cb37c85ba7f7'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:23 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:12:23 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pANQtHim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:23 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:23 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:23 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.compute.manager [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Attaching volume 929f6450-148d-4788-adce-21bb87016add to /dev/vdb
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93aff1c-22f1-45aa-ad17-8f54b8d27607]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:23 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce92bed-addd-4bb6-b734-ee65648d0388]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d] added
Aug 16 06:12:23 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[662731a5-b362-4187-8fe0-3edb369ed32c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0fbe79-9745-45a1-a0f1-1dc5255c7452]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pANQtHim {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pANQtHim" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadfc7dd-e268-4de2-9c21-951f106c6443]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pANQtHim'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a20195-8cce-40e6-9a55-650422efa0fb]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb2324b-bf84-4324-922f-e8b8cc41d2fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:23 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:23 user nova-compute[74681]: INFO nova.compute.manager [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Attaching volume d9fc8693-02bb-4196-bbac-66435b05ef2b to /dev/sdc
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG os_brick.utils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4b81f9-957c-4bcb-a071-b28ade5a3951]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9af4f97-8c19-4a90-afb0-262dc284817c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3171b92a-682c-47c0-bad9-cf29554ef2f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c700b2-c658-47ba-9fba-ffeff03ba121]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.utils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[720dc6ee-e101-45ae-870b-5581d75bc584]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d, portal: 172.16.0.220,3260]
Aug 16 06:12:24 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[304630ba-2b17-4ae8-b54b-6fbf361f7675]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:24 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[019adcdb-c8fa-4016-accc-3411cbd42560]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[615f84f1-b8dd-46b8-89fd-9e72fb1c3daf]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.utils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating existing volume attachment record: abcf9b02-f5c8-499a-8702-8ce40d36708d {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cb9454-3b32-4b13-9282-b48a90321882]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f7eb23-61ef-4452-9500-568550d9e580]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12a51e-8e4d-4878-adad-2ed93c008d7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:24 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1864235e-be45-47d8-a853-b5b29fc8111f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34a773a-1f11-4496-81f2-4e3c24c136fd]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pANQtHim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:24 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:12:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d007a4-11a9-4a0b-966d-45c3265e0fce]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG os_brick.utils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:24 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Updating existing volume attachment record: b6778c0a-a0bb-4ba6-a901-1ff811dd76be {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '26663616139623639', 'path': '/dev/sdg'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663616139623639', 'path': '/dev/sdg'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GubHvVrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:25 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:25 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:25 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8911520d-1a8e-4506-997f-802388778de6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:25 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cc8f72-2fab-4252-bcb7-04552fcc14a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce] added
Aug 16 06:12:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f81a7c-fd89-4bac-8600-c97efff8dd7f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9706e5e1-2a06-4820-91e6-c1c2432355b6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GubHvVrY {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GubHvVrY" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c26773a-f549-45e3-9398-314fe5744087]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GubHvVrY'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a382fa7-aab9-427b-872c-5b317f679e43]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e8d0f-dc46-4b11-b1ac-74771424a188]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d8e57b-e8fb-4414-b491-bc47be6ae6c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce, portal: 172.16.0.220,3260]
Aug 16 06:12:25 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cb5da0-7adc-424e-9bf2-24bef971a196]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b64b0bf-75c6-40e4-aded-608a4209e50c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:25 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[285cd91b-dc36-40a4-8671-d9de0b1584b3]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GubHvVrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26239383834363663', 'path': '/dev/sdh'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239383834363663', 'path': '/dev/sdh'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRBHbPQs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:26 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:26 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:26 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae194a0-0863-4020-ae40-033814159f6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:26 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7951aab-3f05-49f4-ace1-2ee43ebfd613]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7] added
Aug 16 06:12:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19c2009-a000-4116-868d-2e99936685e3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9574d8b-858b-4d83-9476-9361a81feb84]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRBHbPQs {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vRBHbPQs" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dd557d-25e2-41c9-85a4-60efc70e928a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vRBHbPQs'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f35fb5-d61c-47c1-8ffd-3b09e25f1be9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ad093-cdca-49da-9123-fa3b598819e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9596dd51-576f-49ac-853a-5681816f9674]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7, portal: 172.16.0.220,3260]
Aug 16 06:12:26 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b243c7d-50dd-4217-a398-2625a3f2a191]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416c6d6-4a10-45ad-aece-fea289cb41e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:26 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f22289-1390-4848-9e39-4843dcd7a505]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:27 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRBHbPQs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23339373965616433', 'path': '/dev/sdi'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339373965616433', 'path': '/dev/sdi'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:79:94,bridge_name='br-int',has_traffic_filtering=True,id=2444d2a9-2e73-4b49-8a8c-431f68776ab9,network=Network(97119a6b-434e-442f-8757-a206b3c983c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2444d2a9-2e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:18,bridge_name='br-int',has_traffic_filtering=True,id=3bca746f-2df6-435e-85c2-f789ea8a5b8f,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bca746f-2d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=14771914-909d-4cb0-a675-0a818671475d,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14771914-90') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:91:86,bridge_name='br-int',has_traffic_filtering=True,id=9bb0411a-1cc3-491e-92a5-c5e54215a898,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bb0411a-1c') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:e6,bridge_name='br-int',has_traffic_filtering=True,id=7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6de23-b3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ee:9a,bridge_name='br-int',has_traffic_filtering=True,id=048cf7d9-d093-41eb-b546-a00c669a3dab,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap048cf7d9-d0') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:7f:66,bridge_name='br-int',has_traffic_filtering=True,id=368b421b-b98c-4fe9-919b-aa74db34f552,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b421b-b9') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:12:28 user nova-compute[74681]:   <uuid>3a31765d-c4f1-40f6-b63d-ed0830d4bed4</uuid>
Aug 16 06:12:28 user nova-compute[74681]:   <name>instance-0000000c</name>
Aug 16 06:12:28 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:12:28 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:12:28 user nova-compute[74681]:   <metadata>
Aug 16 06:12:28 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:28 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:12:28 user nova-compute[74681]:       <nova:name>tempest-device-tagging-server-1075213555</nova:name>
Aug 16 06:12:28 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:12:23</nova:creationTime>
Aug 16 06:12:28 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:12:28 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:28 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:12:28 user nova-compute[74681]:       <nova:owner>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:user uuid="df7ed94a0d504fb082655852eacc3f50">tempest-TaggedBootDevicesTest_v242-1526081836-project-member</nova:user>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:project uuid="83bf6983951747c287a2099077b61233">tempest-TaggedBootDevicesTest_v242-1526081836</nova:project>
Aug 16 06:12:28 user nova-compute[74681]:       </nova:owner>
Aug 16 06:12:28 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:28 user nova-compute[74681]:       <nova:ports>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:port uuid="2444d2a9-2e73-4b49-8a8c-431f68776ab9">
Aug 16 06:12:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:12:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:port uuid="3bca746f-2df6-435e-85c2-f789ea8a5b8f">
Aug 16 06:12:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Aug 16 06:12:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:port uuid="14771914-909d-4cb0-a675-0a818671475d">
Aug 16 06:12:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Aug 16 06:12:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:port uuid="9bb0411a-1cc3-491e-92a5-c5e54215a898">
Aug 16 06:12:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.1.1.247" ipVersion="4"/>
Aug 16 06:12:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:port uuid="7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4">
Aug 16 06:12:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Aug 16 06:12:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:port uuid="048cf7d9-d093-41eb-b546-a00c669a3dab">
Aug 16 06:12:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 06:12:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:28 user nova-compute[74681]:         <nova:port uuid="368b421b-b98c-4fe9-919b-aa74db34f552">
Aug 16 06:12:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 06:12:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:12:28 user nova-compute[74681]:       </nova:ports>
Aug 16 06:12:28 user nova-compute[74681]:     </nova:instance>
Aug 16 06:12:28 user nova-compute[74681]:   </metadata>
Aug 16 06:12:28 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:12:28 user nova-compute[74681]:     <system>
Aug 16 06:12:28 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:12:28 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:12:28 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:12:28 user nova-compute[74681]:       <entry name="serial">3a31765d-c4f1-40f6-b63d-ed0830d4bed4</entry>
Aug 16 06:12:28 user nova-compute[74681]:       <entry name="uuid">3a31765d-c4f1-40f6-b63d-ed0830d4bed4</entry>
Aug 16 06:12:28 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:12:28 user nova-compute[74681]:     </system>
Aug 16 06:12:28 user nova-compute[74681]:   </sysinfo>
Aug 16 06:12:28 user nova-compute[74681]:   <os>
Aug 16 06:12:28 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:12:28 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:12:28 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:12:28 user nova-compute[74681]:   </os>
Aug 16 06:12:28 user nova-compute[74681]:   <features>
Aug 16 06:12:28 user nova-compute[74681]:     <acpi/>
Aug 16 06:12:28 user nova-compute[74681]:     <apic/>
Aug 16 06:12:28 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:12:28 user nova-compute[74681]:   </features>
Aug 16 06:12:28 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:12:28 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:12:28 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:12:28 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:12:28 user nova-compute[74681]:   </clock>
Aug 16 06:12:28 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:12:28 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:12:28 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:12:28 user nova-compute[74681]:   </cpu>
Aug 16 06:12:28 user nova-compute[74681]:   <devices>
Aug 16 06:12:28 user nova-compute[74681]:     <disk type="file" device="cdrom">
Aug 16 06:12:28 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 06:12:28 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/3a31765d-c4f1-40f6-b63d-ed0830d4bed4/disk.config"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="hda" bus="ide"/>
Aug 16 06:12:28 user nova-compute[74681]:     </disk>
Aug 16 06:12:28 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:12:28 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:28 user nova-compute[74681]:       <source dev="/dev/sdg"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <serial>f4b86c91-e1b5-4e3f-8c24-12d92e6b899d</serial>
Aug 16 06:12:28 user nova-compute[74681]:     </disk>
Aug 16 06:12:28 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:12:28 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:28 user nova-compute[74681]:       <source dev="/dev/sdh"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <serial>fb087afb-be48-4a76-92a5-46940f01d7ce</serial>
Aug 16 06:12:28 user nova-compute[74681]:     </disk>
Aug 16 06:12:28 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:12:28 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:28 user nova-compute[74681]:       <source dev="/dev/sdi"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="vdc" bus="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <serial>b1a00e52-852a-4e4b-a35e-cb37c85ba7f7</serial>
Aug 16 06:12:28 user nova-compute[74681]:     </disk>
Aug 16 06:12:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:28 user nova-compute[74681]:       <mac address="fa:16:3e:44:79:94"/>
Aug 16 06:12:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="tap2444d2a9-2e"/>
Aug 16 06:12:28 user nova-compute[74681]:     </interface>
Aug 16 06:12:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:28 user nova-compute[74681]:       <mac address="fa:16:3e:ad:01:18"/>
Aug 16 06:12:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="tap3bca746f-2d"/>
Aug 16 06:12:28 user nova-compute[74681]:     </interface>
Aug 16 06:12:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:28 user nova-compute[74681]:       <mac address="fa:16:3e:e6:5f:03"/>
Aug 16 06:12:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="tap14771914-90"/>
Aug 16 06:12:28 user nova-compute[74681]:     </interface>
Aug 16 06:12:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:28 user nova-compute[74681]:       <mac address="fa:16:3e:cf:91:86"/>
Aug 16 06:12:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="tap9bb0411a-1c"/>
Aug 16 06:12:28 user nova-compute[74681]:     </interface>
Aug 16 06:12:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:28 user nova-compute[74681]:       <mac address="fa:16:3e:b0:0e:e6"/>
Aug 16 06:12:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="tap7fb6de23-b3"/>
Aug 16 06:12:28 user nova-compute[74681]:     </interface>
Aug 16 06:12:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:28 user nova-compute[74681]:       <mac address="fa:16:3e:b7:ee:9a"/>
Aug 16 06:12:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="tap048cf7d9-d0"/>
Aug 16 06:12:28 user nova-compute[74681]:     </interface>
Aug 16 06:12:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:12:28 user nova-compute[74681]:       <mac address="fa:16:3e:df:7f:66"/>
Aug 16 06:12:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:12:28 user nova-compute[74681]:       <target dev="tap368b421b-b9"/>
Aug 16 06:12:28 user nova-compute[74681]:     </interface>
Aug 16 06:12:28 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:12:28 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/3a31765d-c4f1-40f6-b63d-ed0830d4bed4/console.log" append="off"/>
Aug 16 06:12:28 user nova-compute[74681]:     </serial>
Aug 16 06:12:28 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:12:28 user nova-compute[74681]:     <video>
Aug 16 06:12:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:12:28 user nova-compute[74681]:     </video>
Aug 16 06:12:28 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:12:28 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:12:28 user nova-compute[74681]:     </rng>
Aug 16 06:12:28 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:12:28 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:12:28 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:12:28 user nova-compute[74681]:     </memballoon>
Aug 16 06:12:28 user nova-compute[74681]:   </devices>
Aug 16 06:12:28 user nova-compute[74681]: </domain>
Aug 16 06:12:28 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:79:94,bridge_name='br-int',has_traffic_filtering=True,id=2444d2a9-2e73-4b49-8a8c-431f68776ab9,network=Network(97119a6b-434e-442f-8757-a206b3c983c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2444d2a9-2e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:79:94,bridge_name='br-int',has_traffic_filtering=True,id=2444d2a9-2e73-4b49-8a8c-431f68776ab9,network=Network(97119a6b-434e-442f-8757-a206b3c983c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2444d2a9-2e') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2444d2a9-2e, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2444d2a9-2e, col_values=(('external_ids', {'iface-id': '2444d2a9-2e73-4b49-8a8c-431f68776ab9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:79:94', 'vm-uuid': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: INFO os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:79:94,bridge_name='br-int',has_traffic_filtering=True,id=2444d2a9-2e73-4b49-8a8c-431f68776ab9,network=Network(97119a6b-434e-442f-8757-a206b3c983c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2444d2a9-2e')
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:18,bridge_name='br-int',has_traffic_filtering=True,id=3bca746f-2df6-435e-85c2-f789ea8a5b8f,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bca746f-2d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:18,bridge_name='br-int',has_traffic_filtering=True,id=3bca746f-2df6-435e-85c2-f789ea8a5b8f,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bca746f-2d') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bca746f-2d, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bca746f-2d, col_values=(('external_ids', {'iface-id': '3bca746f-2df6-435e-85c2-f789ea8a5b8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:01:18', 'vm-uuid': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: INFO os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:18,bridge_name='br-int',has_traffic_filtering=True,id=3bca746f-2df6-435e-85c2-f789ea8a5b8f,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bca746f-2d')
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=14771914-909d-4cb0-a675-0a818671475d,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14771914-90') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=14771914-909d-4cb0-a675-0a818671475d,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14771914-90') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14771914-90, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14771914-90, col_values=(('external_ids', {'iface-id': '14771914-909d-4cb0-a675-0a818671475d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:5f:03', 'vm-uuid': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: INFO os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=14771914-909d-4cb0-a675-0a818671475d,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14771914-90')
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:91:86,bridge_name='br-int',has_traffic_filtering=True,id=9bb0411a-1cc3-491e-92a5-c5e54215a898,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bb0411a-1c') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:91:86,bridge_name='br-int',has_traffic_filtering=True,id=9bb0411a-1cc3-491e-92a5-c5e54215a898,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bb0411a-1c') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bb0411a-1c, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9bb0411a-1c, col_values=(('external_ids', {'iface-id': '9bb0411a-1cc3-491e-92a5-c5e54215a898', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:91:86', 'vm-uuid': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:28 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:28 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:28 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: INFO os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:91:86,bridge_name='br-int',has_traffic_filtering=True,id=9bb0411a-1cc3-491e-92a5-c5e54215a898,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bb0411a-1c')
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:e6,bridge_name='br-int',has_traffic_filtering=True,id=7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6de23-b3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:e6,bridge_name='br-int',has_traffic_filtering=True,id=7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6de23-b3') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[962d1b27-7f8c-438a-ba54-61f0075116c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:28 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fb6de23-b3, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7fb6de23-b3, col_values=(('external_ids', {'iface-id': '7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:0e:e6', 'vm-uuid': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edd771e-70b2-4288-9046-efe9915d1bfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc] added
Aug 16 06:12:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: INFO os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:e6,bridge_name='br-int',has_traffic_filtering=True,id=7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6de23-b3')
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ee:9a,bridge_name='br-int',has_traffic_filtering=True,id=048cf7d9-d093-41eb-b546-a00c669a3dab,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap048cf7d9-d0') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ee:9a,bridge_name='br-int',has_traffic_filtering=True,id=048cf7d9-d093-41eb-b546-a00c669a3dab,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap048cf7d9-d0') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddc23ec-5fe3-4802-b3d2-efb5a6c95cae]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap048cf7d9-d0, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap048cf7d9-d0, col_values=(('external_ids', {'iface-id': '048cf7d9-d093-41eb-b546-a00c669a3dab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:ee:9a', 'vm-uuid': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e5d77b-55ea-40cf-8c5c-385ce9bc1aa3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MyhGqFKc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MyhGqFKc" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7017cd44-beeb-47ef-bc0b-411a8e7eb165]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MyhGqFKc'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: INFO os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ee:9a,bridge_name='br-int',has_traffic_filtering=True,id=048cf7d9-d093-41eb-b546-a00c669a3dab,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap048cf7d9-d0')
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:7f:66,bridge_name='br-int',has_traffic_filtering=True,id=368b421b-b98c-4fe9-919b-aa74db34f552,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b421b-b9') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7f:66,bridge_name='br-int',has_traffic_filtering=True,id=368b421b-b98c-4fe9-919b-aa74db34f552,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b421b-b9') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[836485d6-a5b6-4412-a786-b0387e14935a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap368b421b-b9, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap368b421b-b9, col_values=(('external_ids', {'iface-id': '368b421b-b98c-4fe9-919b-aa74db34f552', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:7f:66', 'vm-uuid': '3a31765d-c4f1-40f6-b63d-ed0830d4bed4'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf03b705-e5e1-4af6-bea0-4dc91a329d99]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:28 user nova-compute[74681]: INFO os_vif [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7f:66,bridge_name='br-int',has_traffic_filtering=True,id=368b421b-b98c-4fe9-919b-aa74db34f552,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b421b-b9')
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0fd707-71bc-4464-8286-2ac26aaf3386]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260]
Aug 16 06:12:28 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f631a3-35bb-4f26-94a9-cc53f0f32ae5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] No BDM found with device name hda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] No VIF found with MAC fa:16:3e:44:79:94, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] No VIF found with MAC fa:16:3e:b0:0e:e6, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Using config drive
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[424588dd-e5a6-4aed-9729-dbf7f891e213]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:28 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea67b027-8266-4e2d-abae-f492c6b4be6b]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Creating config drive at /opt/stack/data/nova/instances/3a31765d-c4f1-40f6-b63d-ed0830d4bed4/disk.config
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a31765d-c4f1-40f6-b63d-ed0830d4bed4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps8kj5n7o {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a31765d-c4f1-40f6-b63d-ed0830d4bed4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps8kj5n7o" returned: 0 in 0.060s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23932643963346532', 'path': '/dev/sdj'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932643963346532', 'path': '/dev/sdj'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:29 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lazy-loading 'flavor' on Instance uuid 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:12:29 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:29 user nova-compute[74681]:   <source dev="/dev/sdj"/>
Aug 16 06:12:29 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:29 user nova-compute[74681]:   <serial>beea31e9-502c-4616-ae6a-7781574bbbbc</serial>
Aug 16 06:12:29 user nova-compute[74681]: </disk>
Aug 16 06:12:29 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] No VIF found with MAC fa:16:3e:92:c7:9a, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-5964a753-2e85-403d-853e-1a67c4533675 req-8c0c86a2-31c1-40e6-9495-60da5fcf5c48 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5964a753-2e85-403d-853e-1a67c4533675 req-8c0c86a2-31c1-40e6-9495-60da5fcf5c48 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5964a753-2e85-403d-853e-1a67c4533675 req-8c0c86a2-31c1-40e6-9495-60da5fcf5c48 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5964a753-2e85-403d-853e-1a67c4533675 req-8c0c86a2-31c1-40e6-9495-60da5fcf5c48 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-5964a753-2e85-403d-853e-1a67c4533675 req-8c0c86a2-31c1-40e6-9495-60da5fcf5c48 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:31 user nova-compute[74681]: WARNING nova.compute.manager [req-5964a753-2e85-403d-853e-1a67c4533675 req-8c0c86a2-31c1-40e6-9495-60da5fcf5c48 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 for instance with vm_state building and task_state spawning.
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emZKVTvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:31 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:31 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:31 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13deb60-fe6d-4f8f-8b07-771f998d2290]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:31 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ba535-cefe-478b-a536-2d3db897775e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3] added
Aug 16 06:12:31 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0ecf6-b879-4b43-a825-071fcba47459]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[96509a86-3f28-464e-ad6b-44aa591f8a7a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v emZKVTvU {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v emZKVTvU" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[313bb494-7860-4a82-b836-645893a20522]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'emZKVTvU'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89936d4-93f4-4fa0-8cd0-5ed6ea5f8388]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-74b79da7-6536-495f-9e2b-24e5b6258251 req-2b478eb2-2162-4b0f-80a9-8738ea7bd408 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-74b79da7-6536-495f-9e2b-24e5b6258251 req-2b478eb2-2162-4b0f-80a9-8738ea7bd408 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-74b79da7-6536-495f-9e2b-24e5b6258251 req-2b478eb2-2162-4b0f-80a9-8738ea7bd408 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-74b79da7-6536-495f-9e2b-24e5b6258251 req-2b478eb2-2162-4b0f-80a9-8738ea7bd408 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-74b79da7-6536-495f-9e2b-24e5b6258251 req-2b478eb2-2162-4b0f-80a9-8738ea7bd408 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:31 user nova-compute[74681]: WARNING nova.compute.manager [req-74b79da7-6536-495f-9e2b-24e5b6258251 req-2b478eb2-2162-4b0f-80a9-8738ea7bd408 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d for instance with vm_state building and task_state spawning.
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc351484-c504-47b9-8b7d-c7e55b097e93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:31 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:31 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17bb4023-2c90-4eba-a7a6-c89197dea00d tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.934s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.151s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c36476-8ef1-4a0a-bb0e-01389cb1ba56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3, portal: 172.16.0.220,3260]
Aug 16 06:12:32 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7830f7-f899-4f59-89dc-bb7d2522de4f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f20d90-e603-43fe-bda4-efffdd15cafe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:32 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.511s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.042s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[36161265-1a49-4e3b-872a-0313ceabd635]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emZKVTvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:33 user nova-compute[74681]: INFO nova.compute.manager [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Detaching volume ec814657-7ed7-43fb-ac22-37fa8aaca265
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:33 user nova-compute[74681]: WARNING nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 for instance with vm_state building and task_state spawning.
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:33 user nova-compute[74681]: WARNING nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f for instance with vm_state building and task_state spawning.
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:33 user nova-compute[74681]: WARNING nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f for instance with vm_state building and task_state spawning.
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:33 user nova-compute[74681]: WARNING nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 for instance with vm_state building and task_state spawning.
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:33 user nova-compute[74681]: WARNING nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 for instance with vm_state building and task_state spawning.
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:33 user nova-compute[74681]: WARNING nova.compute.manager [req-518368d0-5af7-42a4-8014-aeba45ca0e9b req-554fbc20-bed6-4942-861f-86e2553d9e6e service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab for instance with vm_state building and task_state spawning.
Aug 16 06:12:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:33 user nova-compute[74681]: INFO nova.virt.block_device [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Attempting to driver detach volume ec814657-7ed7-43fb-ac22-37fa8aaca265 from mountpoint /dev/vdb
Aug 16 06:12:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Attempting to detach device vdb from instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:12:33 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:33 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:33 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:33 user nova-compute[74681]:   <serial>ec814657-7ed7-43fb-ac22-37fa8aaca265</serial>
Aug 16 06:12:33 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:12:33 user nova-compute[74681]: </disk>
Aug 16 06:12:33 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.584s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] <== connect_volume: return (1586ms) {'type': 'block', 'scsi_wwn': '23139633130646333', 'path': '/dev/sdk'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139633130646333', 'path': '/dev/sdk'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Successfully detached device vdb from instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 from the persistent domain config.
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:12:33 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:33 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:33 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:33 user nova-compute[74681]:   <serial>ec814657-7ed7-43fb-ac22-37fa8aaca265</serial>
Aug 16 06:12:33 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:12:33 user nova-compute[74681]: </disk>
Aug 16 06:12:33 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lazy-loading 'flavor' on Instance uuid 2f74fd47-e29b-4392-9af3-eabed0d91993 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 06:12:33 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:33 user nova-compute[74681]:   <source dev="/dev/sdk"/>
Aug 16 06:12:33 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:33 user nova-compute[74681]:   <serial>b092283a-adfd-4f0e-ba34-8a0c682a55e3</serial>
Aug 16 06:12:33 user nova-compute[74681]: </disk>
Aug 16 06:12:33 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166353.7998788, 6fa74c3d-f621-4cf2-8763-6d75109fb113 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:12:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Successfully detached device vdb from instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 from the live domain config.
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.utils [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHPnBKbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:33 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b1314-4750-4f79-a1f1-54ba374b16c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e246aae-d53b-4560-90f2-c30d2b4a0e5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[277013da-2291-4e88-b9e0-15f6fa9ce421]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[61538e5d-87a8-4bdd-9bc5-074f5811d945]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9172a8-936f-4b0d-a5f0-99ac1734a1c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e316db07-e5ba-40ce-a024-3692628f27c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:33 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:33 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94940ead40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265'): ({'sdf'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Removing single pathed devices sdf {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:12:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:34 user nova-compute[74681]: WARNING nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d for instance with vm_state building and task_state spawning.
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:34 user nova-compute[74681]: WARNING nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 for instance with vm_state building and task_state spawning.
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:34 user nova-compute[74681]: WARNING nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 for instance with vm_state building and task_state spawning.
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:34 user nova-compute[74681]: WARNING nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 for instance with vm_state building and task_state spawning.
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:34 user nova-compute[74681]: WARNING nova.compute.manager [req-d57cb621-78b2-42f9-853a-475e6eab12da req-4d2568d2-ff07-497d-b4f2-b9e8985fef93 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 for instance with vm_state building and task_state spawning.
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:34 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23772fa-3382-4674-9366-49d6638f3a4d]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa268464-3cf6-460f-86cb-4bbf00834a00]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.utils [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e21f4b-d73d-4cc0-8d63-f0783897400e]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Flushing IO for device /dev/sdf {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f653aa9b-6cb1-45dc-a94b-f453766c1d8a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.138s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[05078594-5dc6-4ff4-bc0a-f479a5e63931]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:12:34 user nova-compute[74681]: INFO nova.compute.manager [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Swapping volume beea31e9-502c-4616-ae6a-7781574bbbbc for c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5c03b8-429c-4898-bfc8-4b6c16baf08b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e602446-070f-4c77-813a-5360a37af72a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265, portal: 172.16.0.220,3260]
Aug 16 06:12:34 user nova-compute[74681]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:34 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] No VIF found with MAC fa:16:3e:a4:d5:10, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec814657-7ed7-43fb-ac22-37fa8aaca265 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c65d37c-096f-4fc6-8206-2248744eed74]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.639s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] <== disconnect_volume: return (640ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-1cecfcc2-ba8d-400b-b6cc-ad9fb94465be req-197bc0a9-c838-40b3-ac01-d1fdbcf34943 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1cecfcc2-ba8d-400b-b6cc-ad9fb94465be req-197bc0a9-c838-40b3-ac01-d1fdbcf34943 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1cecfcc2-ba8d-400b-b6cc-ad9fb94465be req-197bc0a9-c838-40b3-ac01-d1fdbcf34943 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1cecfcc2-ba8d-400b-b6cc-ad9fb94465be req-197bc0a9-c838-40b3-ac01-d1fdbcf34943 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-1cecfcc2-ba8d-400b-b6cc-ad9fb94465be req-197bc0a9-c838-40b3-ac01-d1fdbcf34943 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:35 user nova-compute[74681]: WARNING nova.compute.manager [req-1cecfcc2-ba8d-400b-b6cc-ad9fb94465be req-197bc0a9-c838-40b3-ac01-d1fdbcf34943 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab for instance with vm_state building and task_state spawning.
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166355.4313643, 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:12:35 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] VM Resumed (Lifecycle Event)
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance spawned successfully.
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:12:35 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166355.4332705, 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:12:35 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] VM Started (Lifecycle Event)
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:12:35 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:12:35 user nova-compute[74681]: INFO nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Took 11.97 seconds to spawn the instance on the hypervisor.
Aug 16 06:12:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:12:35 user nova-compute[74681]: INFO nova.compute.manager [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Took 69.81 seconds to build instance.
Aug 16 06:12:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a5cfab11-2bbd-4c5c-8292-23f27bc47f25 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 69.924s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tinlmwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:36 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:36 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:36 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8ca56b-f55a-4d5e-b480-263c6c1c9b4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:36 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4454543-51cc-40f7-ac82-40f6082f520c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add] added
Aug 16 06:12:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f87de4c-2fd9-4a5e-ab0c-76bdbd65824b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8385d84a-5c59-40b3-ae36-b1b5a7505c68]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tinlmwua {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tinlmwua" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0834196c-e97b-490f-901f-c46f42ec5d10]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tinlmwua'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4f5a4-1047-4064-8dc1-70d0a0f841e9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab66c083-4e15-4e40-973b-71e96eaf121c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bea44c4-2f1b-4f8c-bad8-0db2f8dda6aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add, portal: 172.16.0.220,3260]
Aug 16 06:12:36 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9fe9b7-f6ba-46f9-aecf-017abcc5180c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6684f531-4258-4901-a5f8-9cb1d4d0195b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:36 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c18bb65-7ae8-4a16-8130-a37a70627c14]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:36 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG nova.objects.instance [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'flavor' on Instance uuid 6fa74c3d-f621-4cf2-8763-6d75109fb113 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-bf4cb3ae-615e-4223-8d41-42db7fceeb9d tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.124s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e0a288d-d295-4ffe-9d5e-f877abb15d7b tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.371s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-581d7a63-44c0-4f26-9f68-5e654d0c09c9 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] volume_snapshot_create: create_info: {'snapshot_id': '4820c3e8-e55c-46d9-b0b5-b2e163d957f5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74681) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-581d7a63-44c0-4f26-9f68-5e654d0c09c9 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] snap xml: <domainsnapshot>
Aug 16 06:12:37 user nova-compute[74681]:   <disks>
Aug 16 06:12:37 user nova-compute[74681]:     <disk name="/dev/sdk" snapshot="external" type="file">
Aug 16 06:12:37 user nova-compute[74681]:       <source file="/dev/new_file"/>
Aug 16 06:12:37 user nova-compute[74681]:     </disk>
Aug 16 06:12:37 user nova-compute[74681]:     <disk name="vda" snapshot="no"/>
Aug 16 06:12:37 user nova-compute[74681]:   </disks>
Aug 16 06:12:37 user nova-compute[74681]: </domainsnapshot>
Aug 16 06:12:37 user nova-compute[74681]:  {{(pid=74681) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG nova.objects.instance [None req-581d7a63-44c0-4f26-9f68-5e654d0c09c9 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lazy-loading 'system_metadata' on Instance uuid 2f74fd47-e29b-4392-9af3-eabed0d91993 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:37 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-581d7a63-44c0-4f26-9f68-5e654d0c09c9 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [None req-581d7a63-44c0-4f26-9f68-5e654d0c09c9 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     rv = execute(f, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     six.reraise(c, e, tb)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     raise value
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     rv = meth(*args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [None req-581d7a63-44c0-4f26-9f68-5e654d0c09c9 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     self._volume_snapshot_create(context, instance, guest,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     rv = execute(f, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     six.reraise(c, e, tb)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     raise value
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     rv = meth(*args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] 
Aug 16 06:12:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a99e617e-31ba-4493-885a-23eb2fabd208 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] volume_snapshot_delete: delete_info: {'volume_id': 'b092283a-adfd-4f0e-ba34-8a0c682a55e3'} {{(pid=74681) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [None req-a99e617e-31ba-4493-885a-23eb2fabd208 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993]     if delete_info['type'] != 'qcow2':
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] KeyError: 'type'
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] 
Aug 16 06:12:37 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tinlmwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26134326432336364', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134326432336364', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:37 user nova-compute[74681]: DEBUG nova.objects.instance [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'flavor' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [None req-581d7a63-44c0-4f26-9f68-5e654d0c09c9 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 4820c3e8-e55c-46d9-b0b5-b2e163d957f5 could not be found.
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 4820c3e8-e55c-46d9-b0b5-b2e163d957f5 could not be found. (HTTP 404) (Request-ID: req-2cda46e5-ad8b-422e-9860-c287212138bb)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 4820c3e8-e55c-46d9-b0b5-b2e163d957f5 could not be found.
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server [None req-581d7a63-44c0-4f26-9f68-5e654d0c09c9 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server 
Aug 16 06:12:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:12:37 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:37 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:37 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:37 user nova-compute[74681]:   <serial>929f6450-148d-4788-adce-21bb87016add</serial>
Aug 16 06:12:37 user nova-compute[74681]: </disk>
Aug 16 06:12:37 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver [None req-a99e617e-31ba-4493-885a-23eb2fabd208 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-77c3d3c0-a1e6-4f08-acf1-2f4b83b591c4)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 06:12:37 user nova-compute[74681]: ERROR nova.virt.libvirt.driver 
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server [None req-a99e617e-31ba-4493-885a-23eb2fabd208 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 06:12:37 user nova-compute[74681]: ERROR oslo_messaging.rpc.server 
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:38 user nova-compute[74681]: INFO nova.compute.manager [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Detaching volume b092283a-adfd-4f0e-ba34-8a0c682a55e3
Aug 16 06:12:38 user nova-compute[74681]: INFO nova.virt.block_device [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Attempting to driver detach volume b092283a-adfd-4f0e-ba34-8a0c682a55e3 from mountpoint /dev/vdb
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No BDM found with device name hda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] No VIF found with MAC fa:16:3e:b1:d3:83, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Attempting to detach device vdb from instance 2f74fd47-e29b-4392-9af3-eabed0d91993 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 06:12:38 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:38 user nova-compute[74681]:   <source dev="/dev/sdk"/>
Aug 16 06:12:38 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:38 user nova-compute[74681]:   <serial>b092283a-adfd-4f0e-ba34-8a0c682a55e3</serial>
Aug 16 06:12:38 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:12:38 user nova-compute[74681]: </disk>
Aug 16 06:12:38 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Successfully detached device vdb from instance 2f74fd47-e29b-4392-9af3-eabed0d91993 from the persistent domain config.
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f74fd47-e29b-4392-9af3-eabed0d91993 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 06:12:38 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:38 user nova-compute[74681]:   <source dev="/dev/sdk"/>
Aug 16 06:12:38 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:38 user nova-compute[74681]:   <serial>b092283a-adfd-4f0e-ba34-8a0c682a55e3</serial>
Aug 16 06:12:38 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:12:38 user nova-compute[74681]: </disk>
Aug 16 06:12:38 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-68c346ba-32ca-48f3-a01e-ff67d60d71a5 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.781s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166358.7525856, 2f74fd47-e29b-4392-9af3-eabed0d91993 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f74fd47-e29b-4392-9af3-eabed0d91993 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:12:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Successfully detached device vdb from instance 2f74fd47-e29b-4392-9af3-eabed0d91993 from the live domain config.
Aug 16 06:12:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'emZKVTvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:38 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdabde92-239f-4af0-b12d-34eede81bcd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[16086653-7e07-4491-8dff-eb020b6ab9ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:38 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:38 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9484618820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3'): ({'sdk'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Removing single pathed devices sdk {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[db698af6-073f-438e-a893-15d5d18c3d53]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e394c9-9ce9-4a28-acc0-2a84374769c3]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Flushing IO for device /dev/sdk {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04b68c5-9173-4a61-a9db-4db803736235]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.064s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fc3cfe-3f11-40be-b964-093928c27aaa]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] SCSI volumes sdk have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:12:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0359acec-7d24-4868-b5b6-5ae22ed6a042]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[407d2c3f-21cc-424a-a1bf-4b525ddf76a7]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3, portal: 172.16.0.220,3260]
Aug 16 06:12:39 user nova-compute[74681]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b092283a-adfd-4f0e-ba34-8a0c682a55e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[602fccb6-64d1-48bd-b703-3160c4605b56]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] <== disconnect_volume: return (369ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG nova.objects.instance [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lazy-loading 'flavor' on Instance uuid 2f74fd47-e29b-4392-9af3-eabed0d91993 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-607f7569-1afc-4d32-84d0-3bf1a2713f55 tempest-VolumesAssistedSnapshotsTest-1461475767 tempest-VolumesAssistedSnapshotsTest-1461475767-project-admin] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.994s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:40 user nova-compute[74681]: INFO nova.compute.manager [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Detaching volume 929f6450-148d-4788-adce-21bb87016add
Aug 16 06:12:40 user nova-compute[74681]: INFO nova.virt.block_device [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Attempting to driver detach volume 929f6450-148d-4788-adce-21bb87016add from mountpoint /dev/vdb
Aug 16 06:12:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Attempting to detach device vdb from instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:12:40 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:40 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:40 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:40 user nova-compute[74681]:   <serial>929f6450-148d-4788-adce-21bb87016add</serial>
Aug 16 06:12:40 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 06:12:40 user nova-compute[74681]: </disk>
Aug 16 06:12:40 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Successfully detached device vdb from instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab from the persistent domain config.
Aug 16 06:12:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:12:40 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:40 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:40 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:12:40 user nova-compute[74681]:   <serial>929f6450-148d-4788-adce-21bb87016add</serial>
Aug 16 06:12:40 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 06:12:40 user nova-compute[74681]: </disk>
Aug 16 06:12:40 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166360.882041, 76acb01b-43fd-4a5b-990d-ee95e09aeeab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:12:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Successfully detached device vdb from instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab from the live domain config.
Aug 16 06:12:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tinlmwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:40 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a0eff-ccf6-400e-87a2-9455b32498d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adbd85d-a98c-414a-8174-235c600c9c6d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:40 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9484619a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add'): ({'sdf'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Removing single pathed devices sdf {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebd40f7-430c-4667-be64-f7af40ed1050]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[61706520-606a-4f2d-8de0-03832f1753b4]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Flushing IO for device /dev/sdf {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c3ac17-40f0-44c6-b05c-172990d72cda]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3433c2e-8733-44d7-a73c-b9047e13b40a]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e834c738-7e58-4b3e-8b4e-e17eac612dea]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3d0722-e143-46bb-aa8a-fb276565099d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add, portal: 172.16.0.220,3260]
Aug 16 06:12:41 user nova-compute[74681]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:41 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929f6450-148d-4788-adce-21bb87016add -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f963a-34bf-47af-a9ac-39eb13491182]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] <== disconnect_volume: return (366ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDCxXzsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:41 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:41 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:41 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f6e5c-efc0-4e92-a341-6990573e4ea2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:41 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd7ecc-cb10-434e-aa32-d408a8179ad4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b] added
Aug 16 06:12:41 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2704cc7-710d-4faf-9c8e-828dec407ea4]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e929e326-0b63-40c2-9326-0b8b7728383d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vDCxXzsO {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vDCxXzsO" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[435fc9dc-060f-46fc-8d7a-9d4ab604a3a3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vDCxXzsO'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[965ce48d-f0d3-4bfe-9cd3-ae917cff9bef]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73d1b3-a510-47d3-8890-d0ca7ee398d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[324a9667-b433-490e-8f59-858f077292a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b, portal: 172.16.0.220,3260]
Aug 16 06:12:41 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:41 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8364ac9-e48e-450b-b078-12e784fc2b38]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d9136-badc-4c2c-a8d8-c57332c6e70d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:41 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:41 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[641dcdc1-ba28-4adf-8de3-fbef2ae45c73]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDCxXzsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'flavor' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9043c271-32d1-4a1d-bf9f-98779022e738 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.973s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "interface-76acb01b-43fd-4a5b-990d-ee95e09aeeab-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "interface-76acb01b-43fd-4a5b-990d-ee95e09aeeab-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'flavor' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converting VIF {"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface> {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface> {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Attempting to detach device tapae0ec7db-8f from instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] detach device xml: <interface type="ethernet">
Aug 16 06:12:42 user nova-compute[74681]:   <mac address="fa:16:3e:57:d5:4f"/>
Aug 16 06:12:42 user nova-compute[74681]:   <model type="virtio"/>
Aug 16 06:12:42 user nova-compute[74681]:   <mtu size="1442"/>
Aug 16 06:12:42 user nova-compute[74681]:   <target dev="tapae0ec7db-8f"/>
Aug 16 06:12:42 user nova-compute[74681]: </interface>
Aug 16 06:12:42 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface> {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 06:12:42 user nova-compute[74681]:   <name>instance-00000007</name>
Aug 16 06:12:42 user nova-compute[74681]:   <uuid>76acb01b-43fd-4a5b-990d-ee95e09aeeab</uuid>
Aug 16 06:12:42 user nova-compute[74681]:   <metadata>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:42 user nova-compute[74681]:   <nova:package version="0.0.0"/>
Aug 16 06:12:42 user nova-compute[74681]:   <nova:name>tempest-device-tagging-server-1139632821</nova:name>
Aug 16 06:12:42 user nova-compute[74681]:   <nova:creationTime>2023-08-16 06:12:19</nova:creationTime>
Aug 16 06:12:42 user nova-compute[74681]:   <nova:flavor name="m1.tiny">
Aug 16 06:12:42 user nova-compute[74681]:     <nova:memory>512</nova:memory>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:disk>1</nova:disk>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:swap>0</nova:swap>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:42 user nova-compute[74681]:   </nova:flavor>
Aug 16 06:12:42 user nova-compute[74681]:   <nova:owner>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:user uuid="9edd2fb688ff4a44b33af0ae3a358f53">tempest-TaggedAttachmentsTest-1137660729-project-member</nova:user>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:project uuid="85a954b5814d46929acbbfbc993c73a3">tempest-TaggedAttachmentsTest-1137660729</nova:project>
Aug 16 06:12:42 user nova-compute[74681]:   </nova:owner>
Aug 16 06:12:42 user nova-compute[74681]:   <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:42 user nova-compute[74681]:   <nova:ports>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:port uuid="3627db91-9415-4563-b459-d2b461b3c470">
Aug 16 06:12:42 user nova-compute[74681]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:12:42 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:42 user nova-compute[74681]:     <nova:port uuid="ae0ec7db-8f6a-4c15-8d97-29ce173e57b7">
Aug 16 06:12:42 user nova-compute[74681]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Aug 16 06:12:42 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:42 user nova-compute[74681]:   </nova:ports>
Aug 16 06:12:42 user nova-compute[74681]: </nova:instance>
Aug 16 06:12:42 user nova-compute[74681]:   </metadata>
Aug 16 06:12:42 user nova-compute[74681]:   <memory unit='KiB'>524288</memory>
Aug 16 06:12:42 user nova-compute[74681]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 06:12:42 user nova-compute[74681]:   <vcpu placement='static'>1</vcpu>
Aug 16 06:12:42 user nova-compute[74681]:   <resource>
Aug 16 06:12:42 user nova-compute[74681]:     <partition>/machine</partition>
Aug 16 06:12:42 user nova-compute[74681]:   </resource>
Aug 16 06:12:42 user nova-compute[74681]:   <sysinfo type='smbios'>
Aug 16 06:12:42 user nova-compute[74681]:     <system>
Aug 16 06:12:42 user nova-compute[74681]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 06:12:42 user nova-compute[74681]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 06:12:42 user nova-compute[74681]:       <entry name='version'>0.0.0</entry>
Aug 16 06:12:42 user nova-compute[74681]:       <entry name='serial'>76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:12:42 user nova-compute[74681]:       <entry name='uuid'>76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:12:42 user nova-compute[74681]:       <entry name='family'>Virtual Machine</entry>
Aug 16 06:12:42 user nova-compute[74681]:     </system>
Aug 16 06:12:42 user nova-compute[74681]:   </sysinfo>
Aug 16 06:12:42 user nova-compute[74681]:   <os>
Aug 16 06:12:42 user nova-compute[74681]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 06:12:42 user nova-compute[74681]:     <boot dev='hd'/>
Aug 16 06:12:42 user nova-compute[74681]:     <smbios mode='sysinfo'/>
Aug 16 06:12:42 user nova-compute[74681]:   </os>
Aug 16 06:12:42 user nova-compute[74681]:   <features>
Aug 16 06:12:42 user nova-compute[74681]:     <acpi/>
Aug 16 06:12:42 user nova-compute[74681]:     <apic/>
Aug 16 06:12:42 user nova-compute[74681]:     <vmcoreinfo state='on'/>
Aug 16 06:12:42 user nova-compute[74681]:   </features>
Aug 16 06:12:42 user nova-compute[74681]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 06:12:42 user nova-compute[74681]:     <model fallback='forbid'>Nehalem</model>
Aug 16 06:12:42 user nova-compute[74681]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 06:12:42 user nova-compute[74681]:     <feature policy='require' name='vme'/>
Aug 16 06:12:42 user nova-compute[74681]:     <feature policy='require' name='x2apic'/>
Aug 16 06:12:42 user nova-compute[74681]:     <feature policy='require' name='hypervisor'/>
Aug 16 06:12:42 user nova-compute[74681]:   </cpu>
Aug 16 06:12:42 user nova-compute[74681]:   <clock offset='utc'>
Aug 16 06:12:42 user nova-compute[74681]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 06:12:42 user nova-compute[74681]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 06:12:42 user nova-compute[74681]:     <timer name='hpet' present='no'/>
Aug 16 06:12:42 user nova-compute[74681]:   </clock>
Aug 16 06:12:42 user nova-compute[74681]:   <on_poweroff>destroy</on_poweroff>
Aug 16 06:12:42 user nova-compute[74681]:   <on_reboot>restart</on_reboot>
Aug 16 06:12:42 user nova-compute[74681]:   <on_crash>destroy</on_crash>
Aug 16 06:12:42 user nova-compute[74681]:   <devices>
Aug 16 06:12:42 user nova-compute[74681]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 06:12:42 user nova-compute[74681]:     <disk type='file' device='disk'>
Aug 16 06:12:42 user nova-compute[74681]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 06:12:42 user nova-compute[74681]:       <source file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk' index='2'/>
Aug 16 06:12:42 user nova-compute[74681]:       <backingStore type='file' index='3'>
Aug 16 06:12:42 user nova-compute[74681]:         <format type='raw'/>
Aug 16 06:12:42 user nova-compute[74681]:         <source file='/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe'/>
Aug 16 06:12:42 user nova-compute[74681]:         <backingStore/>
Aug 16 06:12:42 user nova-compute[74681]:       </backingStore>
Aug 16 06:12:42 user nova-compute[74681]:       <target dev='vda' bus='virtio'/>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='virtio-disk0'/>
Aug 16 06:12:42 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </disk>
Aug 16 06:12:42 user nova-compute[74681]:     <disk type='file' device='cdrom'>
Aug 16 06:12:42 user nova-compute[74681]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 06:12:42 user nova-compute[74681]:       <source file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.config' index='1'/>
Aug 16 06:12:42 user nova-compute[74681]:       <backingStore/>
Aug 16 06:12:42 user nova-compute[74681]:       <target dev='hda' bus='ide'/>
Aug 16 06:12:42 user nova-compute[74681]:       <readonly/>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='ide0-0-0'/>
Aug 16 06:12:42 user nova-compute[74681]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </disk>
Aug 16 06:12:42 user nova-compute[74681]:     <controller type='usb' index='0' model='none'>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='usb'/>
Aug 16 06:12:42 user nova-compute[74681]:     </controller>
Aug 16 06:12:42 user nova-compute[74681]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='pci.0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </controller>
Aug 16 06:12:42 user nova-compute[74681]:     <controller type='ide' index='0'>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='ide'/>
Aug 16 06:12:42 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 06:12:42 user nova-compute[74681]:     </controller>
Aug 16 06:12:42 user nova-compute[74681]:     <interface type='ethernet'>
Aug 16 06:12:42 user nova-compute[74681]:       <mac address='fa:16:3e:b1:d3:83'/>
Aug 16 06:12:42 user nova-compute[74681]:       <target dev='tap3627db91-94'/>
Aug 16 06:12:42 user nova-compute[74681]:       <model type='virtio'/>
Aug 16 06:12:42 user nova-compute[74681]:       <mtu size='1442'/>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='net0'/>
Aug 16 06:12:42 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </interface>
Aug 16 06:12:42 user nova-compute[74681]:     <interface type='ethernet'>
Aug 16 06:12:42 user nova-compute[74681]:       <mac address='fa:16:3e:57:d5:4f'/>
Aug 16 06:12:42 user nova-compute[74681]:       <target dev='tapae0ec7db-8f'/>
Aug 16 06:12:42 user nova-compute[74681]:       <model type='virtio'/>
Aug 16 06:12:42 user nova-compute[74681]:       <mtu size='1442'/>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='net1'/>
Aug 16 06:12:42 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </interface>
Aug 16 06:12:42 user nova-compute[74681]:     <serial type='pty'>
Aug 16 06:12:42 user nova-compute[74681]:       <source path='/dev/pts/6'/>
Aug 16 06:12:42 user nova-compute[74681]:       <log file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log' append='off'/>
Aug 16 06:12:42 user nova-compute[74681]:       <target type='isa-serial' port='0'>
Aug 16 06:12:42 user nova-compute[74681]:         <model name='isa-serial'/>
Aug 16 06:12:42 user nova-compute[74681]:       </target>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='serial0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </serial>
Aug 16 06:12:42 user nova-compute[74681]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 06:12:42 user nova-compute[74681]:       <source path='/dev/pts/6'/>
Aug 16 06:12:42 user nova-compute[74681]:       <log file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log' append='off'/>
Aug 16 06:12:42 user nova-compute[74681]:       <target type='serial' port='0'/>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='serial0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </console>
Aug 16 06:12:42 user nova-compute[74681]:     <input type='mouse' bus='ps2'>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='input0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </input>
Aug 16 06:12:42 user nova-compute[74681]:     <input type='keyboard' bus='ps2'>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='input1'/>
Aug 16 06:12:42 user nova-compute[74681]:     </input>
Aug 16 06:12:42 user nova-compute[74681]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 06:12:42 user nova-compute[74681]:       <listen type='address' address='0.0.0.0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </graphics>
Aug 16 06:12:42 user nova-compute[74681]:     <audio id='1' type='none'/>
Aug 16 06:12:42 user nova-compute[74681]:     <video>
Aug 16 06:12:42 user nova-compute[74681]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='video0'/>
Aug 16 06:12:42 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </video>
Aug 16 06:12:42 user nova-compute[74681]:     <memballoon model='virtio'>
Aug 16 06:12:42 user nova-compute[74681]:       <stats period='10'/>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='balloon0'/>
Aug 16 06:12:42 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </memballoon>
Aug 16 06:12:42 user nova-compute[74681]:     <rng model='virtio'>
Aug 16 06:12:42 user nova-compute[74681]:       <backend model='random'>/dev/urandom</backend>
Aug 16 06:12:42 user nova-compute[74681]:       <alias name='rng0'/>
Aug 16 06:12:42 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 06:12:42 user nova-compute[74681]:     </rng>
Aug 16 06:12:42 user nova-compute[74681]:   </devices>
Aug 16 06:12:42 user nova-compute[74681]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 06:12:42 user nova-compute[74681]:     <label>libvirt-76acb01b-43fd-4a5b-990d-ee95e09aeeab</label>
Aug 16 06:12:42 user nova-compute[74681]:     <imagelabel>libvirt-76acb01b-43fd-4a5b-990d-ee95e09aeeab</imagelabel>
Aug 16 06:12:42 user nova-compute[74681]:   </seclabel>
Aug 16 06:12:42 user nova-compute[74681]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 06:12:42 user nova-compute[74681]:     <label>+64055:+108</label>
Aug 16 06:12:42 user nova-compute[74681]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 06:12:42 user nova-compute[74681]:   </seclabel>
Aug 16 06:12:42 user nova-compute[74681]: </domain>
Aug 16 06:12:42 user nova-compute[74681]:  {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 06:12:42 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Successfully detached device tapae0ec7db-8f from instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab from the persistent domain config.
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] (1/8): Attempting to detach device tapae0ec7db-8f with device alias net1 from instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] detach device xml: <interface type="ethernet">
Aug 16 06:12:42 user nova-compute[74681]:   <mac address="fa:16:3e:57:d5:4f"/>
Aug 16 06:12:42 user nova-compute[74681]:   <model type="virtio"/>
Aug 16 06:12:42 user nova-compute[74681]:   <mtu size="1442"/>
Aug 16 06:12:42 user nova-compute[74681]:   <target dev="tapae0ec7db-8f"/>
Aug 16 06:12:42 user nova-compute[74681]: </interface>
Aug 16 06:12:42 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26336653636653237', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336653636653237', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lazy-loading 'flavor' on Instance uuid 903e763a-6ec7-415a-8db9-c5330cd93aec {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:12:42 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:42 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:42 user nova-compute[74681]:   <target dev="sdc" bus="scsi"/>
Aug 16 06:12:42 user nova-compute[74681]:   <serial>d9fc8693-02bb-4196-bbac-66435b05ef2b</serial>
Aug 16 06:12:42 user nova-compute[74681]:   <address type="drive" controller="0" unit="2"/>
Aug 16 06:12:42 user nova-compute[74681]: </disk>
Aug 16 06:12:42 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166363.1204443, 76acb01b-43fd-4a5b-990d-ee95e09aeeab => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Start waiting for the detach event from libvirt for device tapae0ec7db-8f with device alias net1 for instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface> {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 06:12:43 user nova-compute[74681]:   <name>instance-00000007</name>
Aug 16 06:12:43 user nova-compute[74681]:   <uuid>76acb01b-43fd-4a5b-990d-ee95e09aeeab</uuid>
Aug 16 06:12:43 user nova-compute[74681]:   <metadata>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:43 user nova-compute[74681]:   <nova:package version="0.0.0"/>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:name>tempest-device-tagging-server-1139632821</nova:name>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:creationTime>2023-08-16 06:12:19</nova:creationTime>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:flavor name="m1.tiny">
Aug 16 06:12:43 user nova-compute[74681]:     <nova:memory>512</nova:memory>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:disk>1</nova:disk>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:swap>0</nova:swap>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:43 user nova-compute[74681]:   </nova:flavor>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:owner>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:user uuid="9edd2fb688ff4a44b33af0ae3a358f53">tempest-TaggedAttachmentsTest-1137660729-project-member</nova:user>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:project uuid="85a954b5814d46929acbbfbc993c73a3">tempest-TaggedAttachmentsTest-1137660729</nova:project>
Aug 16 06:12:43 user nova-compute[74681]:   </nova:owner>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:ports>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:port uuid="3627db91-9415-4563-b459-d2b461b3c470">
Aug 16 06:12:43 user nova-compute[74681]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:12:43 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:port uuid="ae0ec7db-8f6a-4c15-8d97-29ce173e57b7">
Aug 16 06:12:43 user nova-compute[74681]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Aug 16 06:12:43 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:43 user nova-compute[74681]:   </nova:ports>
Aug 16 06:12:43 user nova-compute[74681]: </nova:instance>
Aug 16 06:12:43 user nova-compute[74681]:   </metadata>
Aug 16 06:12:43 user nova-compute[74681]:   <memory unit='KiB'>524288</memory>
Aug 16 06:12:43 user nova-compute[74681]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 06:12:43 user nova-compute[74681]:   <vcpu placement='static'>1</vcpu>
Aug 16 06:12:43 user nova-compute[74681]:   <resource>
Aug 16 06:12:43 user nova-compute[74681]:     <partition>/machine</partition>
Aug 16 06:12:43 user nova-compute[74681]:   </resource>
Aug 16 06:12:43 user nova-compute[74681]:   <sysinfo type='smbios'>
Aug 16 06:12:43 user nova-compute[74681]:     <system>
Aug 16 06:12:43 user nova-compute[74681]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 06:12:43 user nova-compute[74681]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 06:12:43 user nova-compute[74681]:       <entry name='version'>0.0.0</entry>
Aug 16 06:12:43 user nova-compute[74681]:       <entry name='serial'>76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:12:43 user nova-compute[74681]:       <entry name='uuid'>76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:12:43 user nova-compute[74681]:       <entry name='family'>Virtual Machine</entry>
Aug 16 06:12:43 user nova-compute[74681]:     </system>
Aug 16 06:12:43 user nova-compute[74681]:   </sysinfo>
Aug 16 06:12:43 user nova-compute[74681]:   <os>
Aug 16 06:12:43 user nova-compute[74681]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 06:12:43 user nova-compute[74681]:     <boot dev='hd'/>
Aug 16 06:12:43 user nova-compute[74681]:     <smbios mode='sysinfo'/>
Aug 16 06:12:43 user nova-compute[74681]:   </os>
Aug 16 06:12:43 user nova-compute[74681]:   <features>
Aug 16 06:12:43 user nova-compute[74681]:     <acpi/>
Aug 16 06:12:43 user nova-compute[74681]:     <apic/>
Aug 16 06:12:43 user nova-compute[74681]:     <vmcoreinfo state='on'/>
Aug 16 06:12:43 user nova-compute[74681]:   </features>
Aug 16 06:12:43 user nova-compute[74681]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 06:12:43 user nova-compute[74681]:     <model fallback='forbid'>Nehalem</model>
Aug 16 06:12:43 user nova-compute[74681]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 06:12:43 user nova-compute[74681]:     <feature policy='require' name='vme'/>
Aug 16 06:12:43 user nova-compute[74681]:     <feature policy='require' name='x2apic'/>
Aug 16 06:12:43 user nova-compute[74681]:     <feature policy='require' name='hypervisor'/>
Aug 16 06:12:43 user nova-compute[74681]:   </cpu>
Aug 16 06:12:43 user nova-compute[74681]:   <clock offset='utc'>
Aug 16 06:12:43 user nova-compute[74681]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 06:12:43 user nova-compute[74681]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 06:12:43 user nova-compute[74681]:     <timer name='hpet' present='no'/>
Aug 16 06:12:43 user nova-compute[74681]:   </clock>
Aug 16 06:12:43 user nova-compute[74681]:   <on_poweroff>destroy</on_poweroff>
Aug 16 06:12:43 user nova-compute[74681]:   <on_reboot>restart</on_reboot>
Aug 16 06:12:43 user nova-compute[74681]:   <on_crash>destroy</on_crash>
Aug 16 06:12:43 user nova-compute[74681]:   <devices>
Aug 16 06:12:43 user nova-compute[74681]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 06:12:43 user nova-compute[74681]:     <disk type='file' device='disk'>
Aug 16 06:12:43 user nova-compute[74681]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 06:12:43 user nova-compute[74681]:       <source file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk' index='2'/>
Aug 16 06:12:43 user nova-compute[74681]:       <backingStore type='file' index='3'>
Aug 16 06:12:43 user nova-compute[74681]:         <format type='raw'/>
Aug 16 06:12:43 user nova-compute[74681]:         <source file='/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe'/>
Aug 16 06:12:43 user nova-compute[74681]:         <backingStore/>
Aug 16 06:12:43 user nova-compute[74681]:       </backingStore>
Aug 16 06:12:43 user nova-compute[74681]:       <target dev='vda' bus='virtio'/>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='virtio-disk0'/>
Aug 16 06:12:43 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </disk>
Aug 16 06:12:43 user nova-compute[74681]:     <disk type='file' device='cdrom'>
Aug 16 06:12:43 user nova-compute[74681]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 06:12:43 user nova-compute[74681]:       <source file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.config' index='1'/>
Aug 16 06:12:43 user nova-compute[74681]:       <backingStore/>
Aug 16 06:12:43 user nova-compute[74681]:       <target dev='hda' bus='ide'/>
Aug 16 06:12:43 user nova-compute[74681]:       <readonly/>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='ide0-0-0'/>
Aug 16 06:12:43 user nova-compute[74681]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </disk>
Aug 16 06:12:43 user nova-compute[74681]:     <controller type='usb' index='0' model='none'>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='usb'/>
Aug 16 06:12:43 user nova-compute[74681]:     </controller>
Aug 16 06:12:43 user nova-compute[74681]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='pci.0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </controller>
Aug 16 06:12:43 user nova-compute[74681]:     <controller type='ide' index='0'>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='ide'/>
Aug 16 06:12:43 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 06:12:43 user nova-compute[74681]:     </controller>
Aug 16 06:12:43 user nova-compute[74681]:     <interface type='ethernet'>
Aug 16 06:12:43 user nova-compute[74681]:       <mac address='fa:16:3e:b1:d3:83'/>
Aug 16 06:12:43 user nova-compute[74681]:       <target dev='tap3627db91-94'/>
Aug 16 06:12:43 user nova-compute[74681]:       <model type='virtio'/>
Aug 16 06:12:43 user nova-compute[74681]:       <mtu size='1442'/>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='net0'/>
Aug 16 06:12:43 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </interface>
Aug 16 06:12:43 user nova-compute[74681]:     <serial type='pty'>
Aug 16 06:12:43 user nova-compute[74681]:       <source path='/dev/pts/6'/>
Aug 16 06:12:43 user nova-compute[74681]:       <log file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log' append='off'/>
Aug 16 06:12:43 user nova-compute[74681]:       <target type='isa-serial' port='0'>
Aug 16 06:12:43 user nova-compute[74681]:         <model name='isa-serial'/>
Aug 16 06:12:43 user nova-compute[74681]:       </target>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='serial0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </serial>
Aug 16 06:12:43 user nova-compute[74681]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 06:12:43 user nova-compute[74681]:       <source path='/dev/pts/6'/>
Aug 16 06:12:43 user nova-compute[74681]:       <log file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log' append='off'/>
Aug 16 06:12:43 user nova-compute[74681]:       <target type='serial' port='0'/>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='serial0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </console>
Aug 16 06:12:43 user nova-compute[74681]:     <input type='mouse' bus='ps2'>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='input0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </input>
Aug 16 06:12:43 user nova-compute[74681]:     <input type='keyboard' bus='ps2'>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='input1'/>
Aug 16 06:12:43 user nova-compute[74681]:     </input>
Aug 16 06:12:43 user nova-compute[74681]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 06:12:43 user nova-compute[74681]:       <listen type='address' address='0.0.0.0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </graphics>
Aug 16 06:12:43 user nova-compute[74681]:     <audio id='1' type='none'/>
Aug 16 06:12:43 user nova-compute[74681]:     <video>
Aug 16 06:12:43 user nova-compute[74681]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='video0'/>
Aug 16 06:12:43 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </video>
Aug 16 06:12:43 user nova-compute[74681]:     <memballoon model='virtio'>
Aug 16 06:12:43 user nova-compute[74681]:       <stats period='10'/>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='balloon0'/>
Aug 16 06:12:43 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </memballoon>
Aug 16 06:12:43 user nova-compute[74681]:     <rng model='virtio'>
Aug 16 06:12:43 user nova-compute[74681]:       <backend model='random'>/dev/urandom</backend>
Aug 16 06:12:43 user nova-compute[74681]:       <alias name='rng0'/>
Aug 16 06:12:43 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 06:12:43 user nova-compute[74681]:     </rng>
Aug 16 06:12:43 user nova-compute[74681]:   </devices>
Aug 16 06:12:43 user nova-compute[74681]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 06:12:43 user nova-compute[74681]:     <label>libvirt-76acb01b-43fd-4a5b-990d-ee95e09aeeab</label>
Aug 16 06:12:43 user nova-compute[74681]:     <imagelabel>libvirt-76acb01b-43fd-4a5b-990d-ee95e09aeeab</imagelabel>
Aug 16 06:12:43 user nova-compute[74681]:   </seclabel>
Aug 16 06:12:43 user nova-compute[74681]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 06:12:43 user nova-compute[74681]:     <label>+64055:+108</label>
Aug 16 06:12:43 user nova-compute[74681]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 06:12:43 user nova-compute[74681]:   </seclabel>
Aug 16 06:12:43 user nova-compute[74681]: </domain>
Aug 16 06:12:43 user nova-compute[74681]:  {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 06:12:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Successfully detached device tapae0ec7db-8f from instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab from the live domain config.
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converting VIF {"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG os_vif [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae0ec7db-8f, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:43 user nova-compute[74681]: INFO os_vif [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f')
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:43 user nova-compute[74681]:   <nova:package version="0.0.0"/>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:name>tempest-device-tagging-server-1139632821</nova:name>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:creationTime>2023-08-16 06:12:43</nova:creationTime>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:flavor name="m1.tiny">
Aug 16 06:12:43 user nova-compute[74681]:     <nova:memory>512</nova:memory>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:disk>1</nova:disk>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:swap>0</nova:swap>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:43 user nova-compute[74681]:   </nova:flavor>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:owner>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:user uuid="9edd2fb688ff4a44b33af0ae3a358f53">tempest-TaggedAttachmentsTest-1137660729-project-member</nova:user>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:project uuid="85a954b5814d46929acbbfbc993c73a3">tempest-TaggedAttachmentsTest-1137660729</nova:project>
Aug 16 06:12:43 user nova-compute[74681]:   </nova:owner>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:43 user nova-compute[74681]:   <nova:ports>
Aug 16 06:12:43 user nova-compute[74681]:     <nova:port uuid="3627db91-9415-4563-b459-d2b461b3c470">
Aug 16 06:12:43 user nova-compute[74681]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:12:43 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:43 user nova-compute[74681]:   </nova:ports>
Aug 16 06:12:43 user nova-compute[74681]: </nova:instance>
Aug 16 06:12:43 user nova-compute[74681]:  {{(pid=74681) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-438f4240-0e8e-4831-9497-2626488f00bc req-14855a4a-2f1d-4442-9b9b-07281902ab14 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-unplugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-438f4240-0e8e-4831-9497-2626488f00bc req-14855a4a-2f1d-4442-9b9b-07281902ab14 service nova] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-438f4240-0e8e-4831-9497-2626488f00bc req-14855a4a-2f1d-4442-9b9b-07281902ab14 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-438f4240-0e8e-4831-9497-2626488f00bc req-14855a4a-2f1d-4442-9b9b-07281902ab14 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-438f4240-0e8e-4831-9497-2626488f00bc req-14855a4a-2f1d-4442-9b9b-07281902ab14 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] No waiting events found dispatching network-vif-unplugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:43 user nova-compute[74681]: WARNING nova.compute.manager [req-438f4240-0e8e-4831-9497-2626488f00bc req-14855a4a-2f1d-4442-9b9b-07281902ab14 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received unexpected event network-vif-unplugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 for instance with vm_state active and task_state None.
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] No BDM found with device name sda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] No VIF found with MAC fa:16:3e:7d:77:8b, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-deleted-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:43 user nova-compute[74681]: INFO nova.compute.manager [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Neutron deleted interface ae0ec7db-8f6a-4c15-8d97-29ce173e57b7; detaching it from the instance and deleting it from the info cache
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d5405e1-ed35-4cdd-b66d-1819044c6a76 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.974s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquired lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.objects.instance [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] Lazy-loading 'system_metadata' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:43 user nova-compute[74681]: DEBUG nova.objects.instance [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] Lazy-loading 'flavor' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.network.os_vif_util [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] Converting VIF {"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.network.os_vif_util [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface> {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 06:12:44 user nova-compute[74681]:   <name>instance-00000007</name>
Aug 16 06:12:44 user nova-compute[74681]:   <uuid>76acb01b-43fd-4a5b-990d-ee95e09aeeab</uuid>
Aug 16 06:12:44 user nova-compute[74681]:   <metadata>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:44 user nova-compute[74681]:   <nova:package version="0.0.0"/>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:name>tempest-device-tagging-server-1139632821</nova:name>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:creationTime>2023-08-16 06:12:43</nova:creationTime>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:flavor name="m1.tiny">
Aug 16 06:12:44 user nova-compute[74681]:     <nova:memory>512</nova:memory>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:disk>1</nova:disk>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:swap>0</nova:swap>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:flavor>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:owner>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:user uuid="9edd2fb688ff4a44b33af0ae3a358f53">tempest-TaggedAttachmentsTest-1137660729-project-member</nova:user>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:project uuid="85a954b5814d46929acbbfbc993c73a3">tempest-TaggedAttachmentsTest-1137660729</nova:project>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:owner>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:ports>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:port uuid="3627db91-9415-4563-b459-d2b461b3c470">
Aug 16 06:12:44 user nova-compute[74681]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:12:44 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:ports>
Aug 16 06:12:44 user nova-compute[74681]: </nova:instance>
Aug 16 06:12:44 user nova-compute[74681]:   </metadata>
Aug 16 06:12:44 user nova-compute[74681]:   <memory unit='KiB'>524288</memory>
Aug 16 06:12:44 user nova-compute[74681]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 06:12:44 user nova-compute[74681]:   <vcpu placement='static'>1</vcpu>
Aug 16 06:12:44 user nova-compute[74681]:   <resource>
Aug 16 06:12:44 user nova-compute[74681]:     <partition>/machine</partition>
Aug 16 06:12:44 user nova-compute[74681]:   </resource>
Aug 16 06:12:44 user nova-compute[74681]:   <sysinfo type='smbios'>
Aug 16 06:12:44 user nova-compute[74681]:     <system>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='version'>0.0.0</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='serial'>76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='uuid'>76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='family'>Virtual Machine</entry>
Aug 16 06:12:44 user nova-compute[74681]:     </system>
Aug 16 06:12:44 user nova-compute[74681]:   </sysinfo>
Aug 16 06:12:44 user nova-compute[74681]:   <os>
Aug 16 06:12:44 user nova-compute[74681]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 06:12:44 user nova-compute[74681]:     <boot dev='hd'/>
Aug 16 06:12:44 user nova-compute[74681]:     <smbios mode='sysinfo'/>
Aug 16 06:12:44 user nova-compute[74681]:   </os>
Aug 16 06:12:44 user nova-compute[74681]:   <features>
Aug 16 06:12:44 user nova-compute[74681]:     <acpi/>
Aug 16 06:12:44 user nova-compute[74681]:     <apic/>
Aug 16 06:12:44 user nova-compute[74681]:     <vmcoreinfo state='on'/>
Aug 16 06:12:44 user nova-compute[74681]:   </features>
Aug 16 06:12:44 user nova-compute[74681]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 06:12:44 user nova-compute[74681]:     <model fallback='forbid'>Nehalem</model>
Aug 16 06:12:44 user nova-compute[74681]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 06:12:44 user nova-compute[74681]:     <feature policy='require' name='vme'/>
Aug 16 06:12:44 user nova-compute[74681]:     <feature policy='require' name='x2apic'/>
Aug 16 06:12:44 user nova-compute[74681]:     <feature policy='require' name='hypervisor'/>
Aug 16 06:12:44 user nova-compute[74681]:   </cpu>
Aug 16 06:12:44 user nova-compute[74681]:   <clock offset='utc'>
Aug 16 06:12:44 user nova-compute[74681]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 06:12:44 user nova-compute[74681]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 06:12:44 user nova-compute[74681]:     <timer name='hpet' present='no'/>
Aug 16 06:12:44 user nova-compute[74681]:   </clock>
Aug 16 06:12:44 user nova-compute[74681]:   <on_poweroff>destroy</on_poweroff>
Aug 16 06:12:44 user nova-compute[74681]:   <on_reboot>restart</on_reboot>
Aug 16 06:12:44 user nova-compute[74681]:   <on_crash>destroy</on_crash>
Aug 16 06:12:44 user nova-compute[74681]:   <devices>
Aug 16 06:12:44 user nova-compute[74681]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 06:12:44 user nova-compute[74681]:     <disk type='file' device='disk'>
Aug 16 06:12:44 user nova-compute[74681]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 06:12:44 user nova-compute[74681]:       <source file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk' index='2'/>
Aug 16 06:12:44 user nova-compute[74681]:       <backingStore type='file' index='3'>
Aug 16 06:12:44 user nova-compute[74681]:         <format type='raw'/>
Aug 16 06:12:44 user nova-compute[74681]:         <source file='/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe'/>
Aug 16 06:12:44 user nova-compute[74681]:         <backingStore/>
Aug 16 06:12:44 user nova-compute[74681]:       </backingStore>
Aug 16 06:12:44 user nova-compute[74681]:       <target dev='vda' bus='virtio'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='virtio-disk0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </disk>
Aug 16 06:12:44 user nova-compute[74681]:     <disk type='file' device='cdrom'>
Aug 16 06:12:44 user nova-compute[74681]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 06:12:44 user nova-compute[74681]:       <source file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.config' index='1'/>
Aug 16 06:12:44 user nova-compute[74681]:       <backingStore/>
Aug 16 06:12:44 user nova-compute[74681]:       <target dev='hda' bus='ide'/>
Aug 16 06:12:44 user nova-compute[74681]:       <readonly/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='ide0-0-0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </disk>
Aug 16 06:12:44 user nova-compute[74681]:     <controller type='usb' index='0' model='none'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='usb'/>
Aug 16 06:12:44 user nova-compute[74681]:     </controller>
Aug 16 06:12:44 user nova-compute[74681]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='pci.0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </controller>
Aug 16 06:12:44 user nova-compute[74681]:     <controller type='ide' index='0'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='ide'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 06:12:44 user nova-compute[74681]:     </controller>
Aug 16 06:12:44 user nova-compute[74681]:     <interface type='ethernet'>
Aug 16 06:12:44 user nova-compute[74681]:       <mac address='fa:16:3e:b1:d3:83'/>
Aug 16 06:12:44 user nova-compute[74681]:       <target dev='tap3627db91-94'/>
Aug 16 06:12:44 user nova-compute[74681]:       <model type='virtio'/>
Aug 16 06:12:44 user nova-compute[74681]:       <mtu size='1442'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='net0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </interface>
Aug 16 06:12:44 user nova-compute[74681]:     <serial type='pty'>
Aug 16 06:12:44 user nova-compute[74681]:       <source path='/dev/pts/6'/>
Aug 16 06:12:44 user nova-compute[74681]:       <log file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log' append='off'/>
Aug 16 06:12:44 user nova-compute[74681]:       <target type='isa-serial' port='0'>
Aug 16 06:12:44 user nova-compute[74681]:         <model name='isa-serial'/>
Aug 16 06:12:44 user nova-compute[74681]:       </target>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='serial0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </serial>
Aug 16 06:12:44 user nova-compute[74681]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 06:12:44 user nova-compute[74681]:       <source path='/dev/pts/6'/>
Aug 16 06:12:44 user nova-compute[74681]:       <log file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log' append='off'/>
Aug 16 06:12:44 user nova-compute[74681]:       <target type='serial' port='0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='serial0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </console>
Aug 16 06:12:44 user nova-compute[74681]:     <input type='mouse' bus='ps2'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='input0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </input>
Aug 16 06:12:44 user nova-compute[74681]:     <input type='keyboard' bus='ps2'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='input1'/>
Aug 16 06:12:44 user nova-compute[74681]:     </input>
Aug 16 06:12:44 user nova-compute[74681]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 06:12:44 user nova-compute[74681]:       <listen type='address' address='0.0.0.0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </graphics>
Aug 16 06:12:44 user nova-compute[74681]:     <audio id='1' type='none'/>
Aug 16 06:12:44 user nova-compute[74681]:     <video>
Aug 16 06:12:44 user nova-compute[74681]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='video0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </video>
Aug 16 06:12:44 user nova-compute[74681]:     <memballoon model='virtio'>
Aug 16 06:12:44 user nova-compute[74681]:       <stats period='10'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='balloon0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </memballoon>
Aug 16 06:12:44 user nova-compute[74681]:     <rng model='virtio'>
Aug 16 06:12:44 user nova-compute[74681]:       <backend model='random'>/dev/urandom</backend>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='rng0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </rng>
Aug 16 06:12:44 user nova-compute[74681]:   </devices>
Aug 16 06:12:44 user nova-compute[74681]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 06:12:44 user nova-compute[74681]:     <label>libvirt-76acb01b-43fd-4a5b-990d-ee95e09aeeab</label>
Aug 16 06:12:44 user nova-compute[74681]:     <imagelabel>libvirt-76acb01b-43fd-4a5b-990d-ee95e09aeeab</imagelabel>
Aug 16 06:12:44 user nova-compute[74681]:   </seclabel>
Aug 16 06:12:44 user nova-compute[74681]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 06:12:44 user nova-compute[74681]:     <label>+64055:+108</label>
Aug 16 06:12:44 user nova-compute[74681]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 06:12:44 user nova-compute[74681]:   </seclabel>
Aug 16 06:12:44 user nova-compute[74681]: </domain>
Aug 16 06:12:44 user nova-compute[74681]:  {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface> {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:57:d5:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapae0ec7db-8f"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 16 06:12:44 user nova-compute[74681]:   <name>instance-00000007</name>
Aug 16 06:12:44 user nova-compute[74681]:   <uuid>76acb01b-43fd-4a5b-990d-ee95e09aeeab</uuid>
Aug 16 06:12:44 user nova-compute[74681]:   <metadata>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:44 user nova-compute[74681]:   <nova:package version="0.0.0"/>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:name>tempest-device-tagging-server-1139632821</nova:name>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:creationTime>2023-08-16 06:12:43</nova:creationTime>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:flavor name="m1.tiny">
Aug 16 06:12:44 user nova-compute[74681]:     <nova:memory>512</nova:memory>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:disk>1</nova:disk>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:swap>0</nova:swap>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:flavor>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:owner>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:user uuid="9edd2fb688ff4a44b33af0ae3a358f53">tempest-TaggedAttachmentsTest-1137660729-project-member</nova:user>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:project uuid="85a954b5814d46929acbbfbc993c73a3">tempest-TaggedAttachmentsTest-1137660729</nova:project>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:owner>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:ports>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:port uuid="3627db91-9415-4563-b459-d2b461b3c470">
Aug 16 06:12:44 user nova-compute[74681]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:12:44 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:ports>
Aug 16 06:12:44 user nova-compute[74681]: </nova:instance>
Aug 16 06:12:44 user nova-compute[74681]:   </metadata>
Aug 16 06:12:44 user nova-compute[74681]:   <memory unit='KiB'>524288</memory>
Aug 16 06:12:44 user nova-compute[74681]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 06:12:44 user nova-compute[74681]:   <vcpu placement='static'>1</vcpu>
Aug 16 06:12:44 user nova-compute[74681]:   <resource>
Aug 16 06:12:44 user nova-compute[74681]:     <partition>/machine</partition>
Aug 16 06:12:44 user nova-compute[74681]:   </resource>
Aug 16 06:12:44 user nova-compute[74681]:   <sysinfo type='smbios'>
Aug 16 06:12:44 user nova-compute[74681]:     <system>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='version'>0.0.0</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='serial'>76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='uuid'>76acb01b-43fd-4a5b-990d-ee95e09aeeab</entry>
Aug 16 06:12:44 user nova-compute[74681]:       <entry name='family'>Virtual Machine</entry>
Aug 16 06:12:44 user nova-compute[74681]:     </system>
Aug 16 06:12:44 user nova-compute[74681]:   </sysinfo>
Aug 16 06:12:44 user nova-compute[74681]:   <os>
Aug 16 06:12:44 user nova-compute[74681]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 06:12:44 user nova-compute[74681]:     <boot dev='hd'/>
Aug 16 06:12:44 user nova-compute[74681]:     <smbios mode='sysinfo'/>
Aug 16 06:12:44 user nova-compute[74681]:   </os>
Aug 16 06:12:44 user nova-compute[74681]:   <features>
Aug 16 06:12:44 user nova-compute[74681]:     <acpi/>
Aug 16 06:12:44 user nova-compute[74681]:     <apic/>
Aug 16 06:12:44 user nova-compute[74681]:     <vmcoreinfo state='on'/>
Aug 16 06:12:44 user nova-compute[74681]:   </features>
Aug 16 06:12:44 user nova-compute[74681]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 06:12:44 user nova-compute[74681]:     <model fallback='forbid'>Nehalem</model>
Aug 16 06:12:44 user nova-compute[74681]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 06:12:44 user nova-compute[74681]:     <feature policy='require' name='vme'/>
Aug 16 06:12:44 user nova-compute[74681]:     <feature policy='require' name='x2apic'/>
Aug 16 06:12:44 user nova-compute[74681]:     <feature policy='require' name='hypervisor'/>
Aug 16 06:12:44 user nova-compute[74681]:   </cpu>
Aug 16 06:12:44 user nova-compute[74681]:   <clock offset='utc'>
Aug 16 06:12:44 user nova-compute[74681]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 06:12:44 user nova-compute[74681]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 06:12:44 user nova-compute[74681]:     <timer name='hpet' present='no'/>
Aug 16 06:12:44 user nova-compute[74681]:   </clock>
Aug 16 06:12:44 user nova-compute[74681]:   <on_poweroff>destroy</on_poweroff>
Aug 16 06:12:44 user nova-compute[74681]:   <on_reboot>restart</on_reboot>
Aug 16 06:12:44 user nova-compute[74681]:   <on_crash>destroy</on_crash>
Aug 16 06:12:44 user nova-compute[74681]:   <devices>
Aug 16 06:12:44 user nova-compute[74681]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 06:12:44 user nova-compute[74681]:     <disk type='file' device='disk'>
Aug 16 06:12:44 user nova-compute[74681]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 06:12:44 user nova-compute[74681]:       <source file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk' index='2'/>
Aug 16 06:12:44 user nova-compute[74681]:       <backingStore type='file' index='3'>
Aug 16 06:12:44 user nova-compute[74681]:         <format type='raw'/>
Aug 16 06:12:44 user nova-compute[74681]:         <source file='/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe'/>
Aug 16 06:12:44 user nova-compute[74681]:         <backingStore/>
Aug 16 06:12:44 user nova-compute[74681]:       </backingStore>
Aug 16 06:12:44 user nova-compute[74681]:       <target dev='vda' bus='virtio'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='virtio-disk0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </disk>
Aug 16 06:12:44 user nova-compute[74681]:     <disk type='file' device='cdrom'>
Aug 16 06:12:44 user nova-compute[74681]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 06:12:44 user nova-compute[74681]:       <source file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk.config' index='1'/>
Aug 16 06:12:44 user nova-compute[74681]:       <backingStore/>
Aug 16 06:12:44 user nova-compute[74681]:       <target dev='hda' bus='ide'/>
Aug 16 06:12:44 user nova-compute[74681]:       <readonly/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='ide0-0-0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </disk>
Aug 16 06:12:44 user nova-compute[74681]:     <controller type='usb' index='0' model='none'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='usb'/>
Aug 16 06:12:44 user nova-compute[74681]:     </controller>
Aug 16 06:12:44 user nova-compute[74681]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='pci.0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </controller>
Aug 16 06:12:44 user nova-compute[74681]:     <controller type='ide' index='0'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='ide'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 06:12:44 user nova-compute[74681]:     </controller>
Aug 16 06:12:44 user nova-compute[74681]:     <interface type='ethernet'>
Aug 16 06:12:44 user nova-compute[74681]:       <mac address='fa:16:3e:b1:d3:83'/>
Aug 16 06:12:44 user nova-compute[74681]:       <target dev='tap3627db91-94'/>
Aug 16 06:12:44 user nova-compute[74681]:       <model type='virtio'/>
Aug 16 06:12:44 user nova-compute[74681]:       <mtu size='1442'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='net0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </interface>
Aug 16 06:12:44 user nova-compute[74681]:     <serial type='pty'>
Aug 16 06:12:44 user nova-compute[74681]:       <source path='/dev/pts/6'/>
Aug 16 06:12:44 user nova-compute[74681]:       <log file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log' append='off'/>
Aug 16 06:12:44 user nova-compute[74681]:       <target type='isa-serial' port='0'>
Aug 16 06:12:44 user nova-compute[74681]:         <model name='isa-serial'/>
Aug 16 06:12:44 user nova-compute[74681]:       </target>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='serial0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </serial>
Aug 16 06:12:44 user nova-compute[74681]:     <console type='pty' tty='/dev/pts/6'>
Aug 16 06:12:44 user nova-compute[74681]:       <source path='/dev/pts/6'/>
Aug 16 06:12:44 user nova-compute[74681]:       <log file='/opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/console.log' append='off'/>
Aug 16 06:12:44 user nova-compute[74681]:       <target type='serial' port='0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='serial0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </console>
Aug 16 06:12:44 user nova-compute[74681]:     <input type='mouse' bus='ps2'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='input0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </input>
Aug 16 06:12:44 user nova-compute[74681]:     <input type='keyboard' bus='ps2'>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='input1'/>
Aug 16 06:12:44 user nova-compute[74681]:     </input>
Aug 16 06:12:44 user nova-compute[74681]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 16 06:12:44 user nova-compute[74681]:       <listen type='address' address='0.0.0.0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </graphics>
Aug 16 06:12:44 user nova-compute[74681]:     <audio id='1' type='none'/>
Aug 16 06:12:44 user nova-compute[74681]:     <video>
Aug 16 06:12:44 user nova-compute[74681]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='video0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </video>
Aug 16 06:12:44 user nova-compute[74681]:     <memballoon model='virtio'>
Aug 16 06:12:44 user nova-compute[74681]:       <stats period='10'/>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='balloon0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </memballoon>
Aug 16 06:12:44 user nova-compute[74681]:     <rng model='virtio'>
Aug 16 06:12:44 user nova-compute[74681]:       <backend model='random'>/dev/urandom</backend>
Aug 16 06:12:44 user nova-compute[74681]:       <alias name='rng0'/>
Aug 16 06:12:44 user nova-compute[74681]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 06:12:44 user nova-compute[74681]:     </rng>
Aug 16 06:12:44 user nova-compute[74681]:   </devices>
Aug 16 06:12:44 user nova-compute[74681]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 06:12:44 user nova-compute[74681]:     <label>libvirt-76acb01b-43fd-4a5b-990d-ee95e09aeeab</label>
Aug 16 06:12:44 user nova-compute[74681]:     <imagelabel>libvirt-76acb01b-43fd-4a5b-990d-ee95e09aeeab</imagelabel>
Aug 16 06:12:44 user nova-compute[74681]:   </seclabel>
Aug 16 06:12:44 user nova-compute[74681]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 06:12:44 user nova-compute[74681]:     <label>+64055:+108</label>
Aug 16 06:12:44 user nova-compute[74681]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 06:12:44 user nova-compute[74681]:   </seclabel>
Aug 16 06:12:44 user nova-compute[74681]: </domain>
Aug 16 06:12:44 user nova-compute[74681]:  {{(pid=74681) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 06:12:44 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Detaching interface fa:16:3e:57:d5:4f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapae0ec7db-8f' not found.
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.network.os_vif_util [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] Converting VIF {"id": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "address": "fa:16:3e:57:d5:4f", "network": {"id": "a3064700-323c-4a3f-818f-390242d2aad0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1196405019", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae0ec7db-8f", "ovs_interfaceid": "ae0ec7db-8f6a-4c15-8d97-29ce173e57b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.network.os_vif_util [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG os_vif [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae0ec7db-8f, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:12:44 user nova-compute[74681]: INFO os_vif [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d5:4f,bridge_name='br-int',has_traffic_filtering=True,id=ae0ec7db-8f6a-4c15-8d97-29ce173e57b7,network=Network(a3064700-323c-4a3f-818f-390242d2aad0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae0ec7db-8f')
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [req-df7fd5cf-df4d-4882-9e28-65ef6a352382 req-81299dba-4f94-44fe-b506-d78c440357d3 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:12:44 user nova-compute[74681]:   <nova:package version="0.0.0"/>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:name>tempest-device-tagging-server-1139632821</nova:name>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:creationTime>2023-08-16 06:12:44</nova:creationTime>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:flavor name="m1.tiny">
Aug 16 06:12:44 user nova-compute[74681]:     <nova:memory>512</nova:memory>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:disk>1</nova:disk>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:swap>0</nova:swap>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:vcpus>1</nova:vcpus>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:flavor>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:owner>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:user uuid="9edd2fb688ff4a44b33af0ae3a358f53">tempest-TaggedAttachmentsTest-1137660729-project-member</nova:user>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:project uuid="85a954b5814d46929acbbfbc993c73a3">tempest-TaggedAttachmentsTest-1137660729</nova:project>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:owner>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:12:44 user nova-compute[74681]:   <nova:ports>
Aug 16 06:12:44 user nova-compute[74681]:     <nova:port uuid="3627db91-9415-4563-b459-d2b461b3c470">
Aug 16 06:12:44 user nova-compute[74681]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:12:44 user nova-compute[74681]:     </nova:port>
Aug 16 06:12:44 user nova-compute[74681]:   </nova:ports>
Aug 16 06:12:44 user nova-compute[74681]: </nova:instance>
Aug 16 06:12:44 user nova-compute[74681]:  {{(pid=74681) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [{"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Releasing lock "refresh_cache-76acb01b-43fd-4a5b-990d-ee95e09aeeab" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f614e0f3-0063-41e7-8b1c-afdbfc68ca2d tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "interface-76acb01b-43fd-4a5b-990d-ee95e09aeeab-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.693s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:44 user nova-compute[74681]: INFO nova.compute.manager [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Detaching volume d9fc8693-02bb-4196-bbac-66435b05ef2b
Aug 16 06:12:44 user nova-compute[74681]: INFO nova.virt.block_device [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Attempting to driver detach volume d9fc8693-02bb-4196-bbac-66435b05ef2b from mountpoint /dev/sdc
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Attempting to detach device sdc from instance 903e763a-6ec7-415a-8db9-c5330cd93aec from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:12:44 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:44 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:44 user nova-compute[74681]:   <target dev="sdc" bus="scsi"/>
Aug 16 06:12:44 user nova-compute[74681]:   <serial>d9fc8693-02bb-4196-bbac-66435b05ef2b</serial>
Aug 16 06:12:44 user nova-compute[74681]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 06:12:44 user nova-compute[74681]: </disk>
Aug 16 06:12:44 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Successfully detached device sdc from instance 903e763a-6ec7-415a-8db9-c5330cd93aec from the persistent domain config.
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 903e763a-6ec7-415a-8db9-c5330cd93aec from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:12:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:12:44 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:12:44 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:12:44 user nova-compute[74681]:   <target dev="sdc" bus="scsi"/>
Aug 16 06:12:44 user nova-compute[74681]:   <serial>d9fc8693-02bb-4196-bbac-66435b05ef2b</serial>
Aug 16 06:12:44 user nova-compute[74681]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 06:12:44 user nova-compute[74681]: </disk>
Aug 16 06:12:44 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-2a899fad-624d-41a7-bbda-adf8790392a7 req-7b5bb04a-1212-4697-9335-e287bd405140 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2a899fad-624d-41a7-bbda-adf8790392a7 req-7b5bb04a-1212-4697-9335-e287bd405140 service nova] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2a899fad-624d-41a7-bbda-adf8790392a7 req-7b5bb04a-1212-4697-9335-e287bd405140 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2a899fad-624d-41a7-bbda-adf8790392a7 req-7b5bb04a-1212-4697-9335-e287bd405140 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-2a899fad-624d-41a7-bbda-adf8790392a7 req-7b5bb04a-1212-4697-9335-e287bd405140 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] No waiting events found dispatching network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:45 user nova-compute[74681]: WARNING nova.compute.manager [req-2a899fad-624d-41a7-bbda-adf8790392a7 req-7b5bb04a-1212-4697-9335-e287bd405140 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received unexpected event network-vif-plugged-ae0ec7db-8f6a-4c15-8d97-29ce173e57b7 for instance with vm_state active and task_state None.
Aug 16 06:12:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166365.3474498, 903e763a-6ec7-415a-8db9-c5330cd93aec => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 903e763a-6ec7-415a-8db9-c5330cd93aec {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:12:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Successfully detached device sdc from instance 903e763a-6ec7-415a-8db9-c5330cd93aec from the live domain config.
Aug 16 06:12:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDCxXzsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:45 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1effda0-2a43-44a7-88ef-4d2c80956481]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df71bf-3c2e-476c-aee5-1ebd9589ef0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:45 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948475fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b'): ({'sdf'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Removing single pathed devices sdf {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7154fe-6a1b-4c16-ab9b-85b24c98d693]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66c2535-b858-4f3a-8402-d7472a33570b]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Flushing IO for device /dev/sdf {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bc4518-3dcd-4a12-9b98-6bb40740d780]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeade2c-e7a8-4bca-8571-f7f042cd026e]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e6c3fa-d573-4feb-9000-9d507eac19e8]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ff7ce4-6765-444f-8025-37a52ced042a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b, portal: 172.16.0.220,3260]
Aug 16 06:12:45 user nova-compute[74681]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9fc8693-02bb-4196-bbac-66435b05ef2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a8940d-dd54-42d9-af9f-16242ec2458a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] <== disconnect_volume: return (326ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGbsCtgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9791d36b-9111-47c7-aa6d-c86645e1a453', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108', 'serial': 'c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '9791d36b-9111-47c7-aa6d-c86645e1a453', 'attached_at': '', 'detached_at': '', 'volume_id': 'beea31e9-502c-4616-ae6a-7781574bbbbc', 'serial'} {{(pid=74681) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGbsCtgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:46 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:46 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:46 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[220b3f4a-1060-4ab7-b340-c812e508e377]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:12:46 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7bf530-7155-48e2-8008-26a8d5452d6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108] added
Aug 16 06:12:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ab834-7035-419a-9bc8-8f145804fd0d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa77203-89b7-4af5-8353-aa9ff12251ac]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGbsCtgV {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGbsCtgV" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[89119126-7817-4650-b132-b95d54c75f1a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yGbsCtgV'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b5df7b-a2c7-40fb-b8a4-f28261584093]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8621133-19c1-4fe0-893c-70ade777c3f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[943d0c81-7358-43c6-905b-f11c55ba7bd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108, portal: 172.16.0.220,3260]
Aug 16 06:12:46 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lazy-loading 'flavor' on Instance uuid 903e763a-6ec7-415a-8db9-c5330cd93aec {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[98092c9d-8714-4f4e-ac7d-532b11411c12]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db52395c-466f-40f3-a461-b22c69dec71d tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0cf71c-ee5e-4ca9-9096-1ec3c44cd744]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:46 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd3f0d5-5486-4675-8e03-373b63ba66ea]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:47 user nova-compute[74681]: INFO nova.compute.manager [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Terminating instance
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGbsCtgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26564343237373432', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564343237373432', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lazy-loading 'flavor' on Instance uuid 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-393752e9-9b92-4e7c-a36b-d2cf3b504c66 req-b282ac7c-874b-48e2-9561-9f55ef40afeb service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received event network-vif-unplugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-393752e9-9b92-4e7c-a36b-d2cf3b504c66 req-b282ac7c-874b-48e2-9561-9f55ef40afeb service nova] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-393752e9-9b92-4e7c-a36b-d2cf3b504c66 req-b282ac7c-874b-48e2-9561-9f55ef40afeb service nova] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-393752e9-9b92-4e7c-a36b-d2cf3b504c66 req-b282ac7c-874b-48e2-9561-9f55ef40afeb service nova] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-393752e9-9b92-4e7c-a36b-d2cf3b504c66 req-b282ac7c-874b-48e2-9561-9f55ef40afeb service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] No waiting events found dispatching network-vif-unplugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-393752e9-9b92-4e7c-a36b-d2cf3b504c66 req-b282ac7c-874b-48e2-9561-9f55ef40afeb service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received event network-vif-unplugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating instance_info_cache with network_info: [{"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:47 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Instance destroyed successfully.
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lazy-loading 'resources' on Instance uuid 903e763a-6ec7-415a-8db9-c5330cd93aec {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-267106615',display_name='tempest-AttachSCSIVolumeTestJSON-server-267106615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-267106615',id=8,image_ref='9988e973-8837-492a-a4fc-bb1e8a7eec51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK++Aw4Bmz49jMu/ZGAWPlv+WsbWQhqFPpEbTFM6MLTulR+f3SAsfdnbQ80g0/1yhuDRyTZpBTb37L7lYnRYvMJyU2CUQJdsisFxxFeppGJB/JiPTTeKspg4ip5DH3jwJQ==',key_name='tempest-keypair-298907551',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34edee75771d4c0993fe85fb7d542866',ramdisk_id='',reservation_id='r-90s034wl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9988e973-8837-492a-a4fc-bb1e8a7eec51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1294003642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1294003642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdcd8eb87804ba58d03751da01af759',uuid=903e763a-6ec7-415a-8db9-c5330cd93aec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Converting VIF {"id": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "address": "fa:16:3e:7d:77:8b", "network": {"id": "1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-770869830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34edee75771d4c0993fe85fb7d542866", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fb9ba0-1e", "ovs_interfaceid": "c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:77:8b,bridge_name='br-int',has_traffic_filtering=True,id=c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d,network=Network(1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fb9ba0-1e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG os_vif [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:77:8b,bridge_name='br-int',has_traffic_filtering=True,id=c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d,network=Network(1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fb9ba0-1e') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0fb9ba0-1e, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:12:48 user nova-compute[74681]: INFO os_vif [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:77:8b,bridge_name='br-int',has_traffic_filtering=True,id=c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d,network=Network(1bc0f3c6-b4f8-457c-9a1c-f2b3dab21c4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fb9ba0-1e')
Aug 16 06:12:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Deleting instance files /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec_del
Aug 16 06:12:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Deletion of /opt/stack/data/nova/instances/903e763a-6ec7-415a-8db9-c5330cd93aec_del complete
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 97517568 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:48 user nova-compute[74681]: INFO nova.compute.manager [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 16 06:12:48 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 256901120 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 442499072 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-6fbe3dc9-f85b-44e7-a3ee-c4cdd19238e5 req-e1df57e1-df07-441e-a7af-6e6d710a7877 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received event network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fbe3dc9-f85b-44e7-a3ee-c4cdd19238e5 req-e1df57e1-df07-441e-a7af-6e6d710a7877 service nova] Acquiring lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fbe3dc9-f85b-44e7-a3ee-c4cdd19238e5 req-e1df57e1-df07-441e-a7af-6e6d710a7877 service nova] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fbe3dc9-f85b-44e7-a3ee-c4cdd19238e5 req-e1df57e1-df07-441e-a7af-6e6d710a7877 service nova] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-6fbe3dc9-f85b-44e7-a3ee-c4cdd19238e5 req-e1df57e1-df07-441e-a7af-6e6d710a7877 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] No waiting events found dispatching network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:12:49 user nova-compute[74681]: WARNING nova.compute.manager [req-6fbe3dc9-f85b-44e7-a3ee-c4cdd19238e5 req-e1df57e1-df07-441e-a7af-6e6d710a7877 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received unexpected event network-vif-plugged-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d for instance with vm_state active and task_state deleting.
Aug 16 06:12:49 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-9d2febfb-aa34-44d8-92fd-0a74773e3f25 req-06efd257-891b-46f5-8244-89d385989c75 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Received event network-vif-deleted-c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:12:49 user nova-compute[74681]: INFO nova.compute.manager [req-9d2febfb-aa34-44d8-92fd-0a74773e3f25 req-06efd257-891b-46f5-8244-89d385989c75 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Neutron deleted interface c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d; detaching it from the instance and deleting it from the info cache
Aug 16 06:12:49 user nova-compute[74681]: DEBUG nova.network.neutron [req-9d2febfb-aa34-44d8-92fd-0a74773e3f25 req-06efd257-891b-46f5-8244-89d385989c75 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:12:49 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Took 1.33 seconds to deallocate network for instance.
Aug 16 06:12:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-9d2febfb-aa34-44d8-92fd-0a74773e3f25 req-06efd257-891b-46f5-8244-89d385989c75 service nova] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Detach interface failed, port_id=c0fb9ba0-1e71-41a5-8b68-5d3c0e43c88d, reason: Instance 903e763a-6ec7-415a-8db9-c5330cd93aec could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 567279616 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:50 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Error from libvirt while getting description of instance-00000008: [Error Code 42] Domain not found: no domain with matching uuid '903e763a-6ec7-415a-8db9-c5330cd93aec' (instance-00000008): libvirt.libvirtError: Domain not found: no domain with matching uuid '903e763a-6ec7-415a-8db9-c5330cd93aec' (instance-00000008)
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 717225984 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.714s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:50 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Deleted allocations for instance 903e763a-6ec7-415a-8db9-c5330cd93aec
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-10c1b911-f26c-4d33-baf3-8d7d2dd4dbf6 tempest-AttachSCSIVolumeTestJSON-1294003642 tempest-AttachSCSIVolumeTestJSON-1294003642-project-member] Lock "903e763a-6ec7-415a-8db9-c5330cd93aec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.708s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 880803840 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 1069547520 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:52 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d288e60-6aac-4804-860d-3cdbaddb4682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d591ee6e-e7c1-453c-b565-ec080746f22b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:12:52 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:12:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948428e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'): ({'sdj'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Removing single pathed devices sdj {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0607d9-16d4-4e16-bca4-383b39cd6d88]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[888aaf97-886f-45c4-a5dd-5e84fa03d9a9]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Flushing IO for device /dev/sdj {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac22c9-f2a3-414d-872a-81bf6e84c1f0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[476a3f8e-dd38-4dc1-a4de-aa8cb31f3eef]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] SCSI volumes sdj have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbdb19b-c039-4dbc-8f73-6cfa271aaba3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[782ca0aa-824f-43da-a3d4-f211fdb8d7e6]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260]
Aug 16 06:12:52 user nova-compute[74681]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260] successful.
Aug 16 06:12:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2b5f94-344f-4e9b-b680-d235c08abf75]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] <== disconnect_volume: return (337ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGbsCtgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '9791d36b-9111-47c7-aa6d-c86645e1a453', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108', 'serial'} {{(pid=74681) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] swap_volume: removing Cinder connection for volume beea31e9-502c-4616-ae6a-7781574bbbbc {{(pid=74681) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] swap_volume: Updating volume beea31e9-502c-4616-ae6a-7781574bbbbc BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "yGbsCtgV", "auth_password": "dT19quftNGn65L", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108"}, "status": "reserved", "instance": "9791d36b-9111-47c7-aa6d-c86645e1a453", "attached_at": "", "detached_at": "", "volume_id": "c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108", "serial": "c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108', 'no_device': None, 'attachment_id': 'eb5668c2-862f-4d60-9d09-3e91795f5ee7'} {{(pid=74681) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:12:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=6672MB free_disk=25.574108123779297GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d96e09f1-ff30-4863-90fa-0050f0100a7c tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.996s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3fa19b27-7628-44ce-b0ae-e1e870337855 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 70390b89-fdfb-4552-98e5-35568c0268bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance d7bc97ea-3b81-488c-8c63-b83a351118d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 9791d36b-9111-47c7-aa6d-c86645e1a453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 2f74fd47-e29b-4392-9af3-eabed0d91993 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ff2064c1-e1bb-4abe-ab33-ced79efbeadc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 266431b4-b49b-4079-b5c7-c0f59f46d201 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance c3c07afb-5fb6-456d-a631-028e7c817b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:12:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:12:54 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:12:54 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:12:54 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:12:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:12:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:12:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG os_brick.utils [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0261aef-581b-41a9-b431-3005f1040692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[981c997b-781f-44a4-bc6d-665840701efb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a475aaa-8d6d-4d91-81cf-9ba8ebd7e2c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4384e15b-741a-4af1-b501-f1527977b1d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:12:55 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:12:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97d988-a0c2-43f4-ac79-16b789f45cdb]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:12:55 user nova-compute[74681]: DEBUG os_brick.utils [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:12:55 user nova-compute[74681]: INFO nova.compute.manager [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Swapping volume c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 for beea31e9-502c-4616-ae6a-7781574bbbbc
Aug 16 06:12:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:12:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:03 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166368.3943295, 903e763a-6ec7-415a-8db9-c5330cd93aec => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:13:03 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] VM Stopped (Lifecycle Event)
Aug 16 06:13:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b1854484-a1e5-48bc-a4f5-df67cfabd69b None None] [instance: 903e763a-6ec7-415a-8db9-c5330cd93aec] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:13:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9791d36b-9111-47c7-aa6d-c86645e1a453', 'attached_at': '', 'detached_at': '', 'volume_id': 'beea31e9-502c-4616-ae6a-7781574bbbbc', 'serial': 'beea31e9-502c-4616-ae6a-7781574bbbbc'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGbsCtgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'}, 'status': 'reserved', 'instance': '9791d36b-9111-47c7-aa6d-c86645e1a453', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108', 'serial'} {{(pid=74681) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:05 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:05 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:05 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61af6b8-4e2f-41f8-9bb4-ece86707b1a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:13:05 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c73fcb4-2c80-49ec-a31d-4e0c611d866b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc] added
Aug 16 06:13:05 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce79021a-9db5-4593-bac0-c6a9dee505ce]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f664cda-70b8-4c59-935c-143d900a04c5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MyhGqFKc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MyhGqFKc" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4519fda-4287-4898-a35e-ccb8db2888bb]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MyhGqFKc'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce741d5a-02bb-47ce-9dd3-4d5313a2a92d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d74a9c3-f6a7-469e-9e40-464c86d3e27f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b76ea-31bc-460f-bee7-e7b53e250292]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260]
Aug 16 06:13:05 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260] successful.
Aug 16 06:13:05 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ac8646-2339-459b-898b-e6ca161b5dd0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f40d2c-103b-47f9-8d37-f6fe93b3b3d0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:05 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:05 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f14ecf-bafe-4f60-b3cb-ef93755f87dd]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:05 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:13:06 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:13:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:13:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23932643963346532', 'path': '/dev/sdj'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932643963346532', 'path': '/dev/sdj'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:13:06 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lazy-loading 'flavor' on Instance uuid 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 130023424 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 441450496 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 601882624 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 757071872 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 902823936 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 1070596096 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGbsCtgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:11 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1de155-9964-4671-93d0-3c8f2b2eb4b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc016c1-74df-483b-b426-aa32e858dcdb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:11 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9484618820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108'): ({'sdf'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Removing single pathed devices sdf {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab8adf-0a51-4cec-9942-6f4e3908eb77]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea3232-bc42-474f-9f6c-ee211b293cfb]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Flushing IO for device /dev/sdf {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a42455a-cfe3-4cf0-9106-04b10e2e5eb0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe5a597-1284-44b7-8b44-7fe1cccf1f19]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e72141-1a1d-4b5b-964d-091831092452]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdcb00f-9747-482d-9763-558d97f5d597]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108, portal: 172.16.0.220,3260]
Aug 16 06:13:11 user nova-compute[74681]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108, portal: 172.16.0.220,3260] successful.
Aug 16 06:13:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f689cec4-e050-4256-8fa5-cb719de18ebf]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] <== disconnect_volume: return (336ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '9791d36b-9111-47c7-aa6d-c86645e1a453', 'attached_at': '', 'detached_at': '', 'volume_id': 'beea31e9-502c-4616-ae6a-7781574bbbbc', 'serial'} {{(pid=74681) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 06:13:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] swap_volume: removing Cinder connection for volume c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 {{(pid=74681) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 06:13:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] swap_volume: Updating volume c0fbc3ea-e8b0-4bdd-8917-7f0e0bd83108 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "MyhGqFKc", "auth_password": "1gnKXl96pmFdD7", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "beea31e9-502c-4616-ae6a-7781574bbbbc"}, "status": "reserved", "instance": "9791d36b-9111-47c7-aa6d-c86645e1a453", "attached_at": "", "detached_at": "", "volume_id": "beea31e9-502c-4616-ae6a-7781574bbbbc", "serial": "beea31e9-502c-4616-ae6a-7781574bbbbc"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'beea31e9-502c-4616-ae6a-7781574bbbbc', 'no_device': None, 'attachment_id': '58ca90d0-aedf-4749-bb06-071d5a24a153'} {{(pid=74681) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 06:13:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0d1e50bd-a869-4b83-af8d-062ba9173dc1 tempest-TestVolumeSwap-1061118698 tempest-TestVolumeSwap-1061118698-project-admin] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.594s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:13 user nova-compute[74681]: INFO nova.compute.manager [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Detaching volume beea31e9-502c-4616-ae6a-7781574bbbbc
Aug 16 06:13:13 user nova-compute[74681]: INFO nova.virt.block_device [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Attempting to driver detach volume beea31e9-502c-4616-ae6a-7781574bbbbc from mountpoint /dev/vdb
Aug 16 06:13:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Attempting to detach device vdb from instance 9791d36b-9111-47c7-aa6d-c86645e1a453 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:13:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:13:13 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:13:13 user nova-compute[74681]:   <source dev="/dev/sdj"/>
Aug 16 06:13:13 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:13:13 user nova-compute[74681]:   <serial>beea31e9-502c-4616-ae6a-7781574bbbbc</serial>
Aug 16 06:13:13 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:13:13 user nova-compute[74681]: </disk>
Aug 16 06:13:13 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:13:13 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Successfully detached device vdb from instance 9791d36b-9111-47c7-aa6d-c86645e1a453 from the persistent domain config.
Aug 16 06:13:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9791d36b-9111-47c7-aa6d-c86645e1a453 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:13:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:13:13 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:13:13 user nova-compute[74681]:   <source dev="/dev/sdj"/>
Aug 16 06:13:13 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:13:13 user nova-compute[74681]:   <serial>beea31e9-502c-4616-ae6a-7781574bbbbc</serial>
Aug 16 06:13:13 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:13:13 user nova-compute[74681]: </disk>
Aug 16 06:13:13 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:13:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166394.1090212, 9791d36b-9111-47c7-aa6d-c86645e1a453 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:13:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Successfully detached device vdb from instance 9791d36b-9111-47c7-aa6d-c86645e1a453 from the live domain config.
Aug 16 06:13:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MyhGqFKc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'beea31e9-502c-4616-ae6a-7781574bbbbc'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:14 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b011f47-7165-47a5-9b5b-d447d5c742e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b0fe92-e545-47ec-9bdd-60df57ed46a5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:14 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94942a60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc'): ({'sdj'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Removing single pathed devices sdj {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a10129-f259-483e-965a-09c36a8cd260]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5bab11-6268-4398-9151-5874b8052430]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Flushing IO for device /dev/sdj {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc68f134-db07-4a95-abd5-b8d4785b55d2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e0bb39-8529-468d-8da1-36f933daa846]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] SCSI volumes sdj have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d1517-6dcc-4c74-8ad5-421b78781e8b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa1dfbc-a35d-4161-8786-7d99b49d19a1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260]
Aug 16 06:13:14 user nova-compute[74681]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc, portal: 172.16.0.220,3260] successful.
Aug 16 06:13:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beea31e9-502c-4616-ae6a-7781574bbbbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[909d476d-c717-4df2-9728-ac0113283a36]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] <== disconnect_volume: return (309ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:13:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lazy-loading 'flavor' on Instance uuid 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ae4269ae-da12-4aed-a52d-c4a3013b3422 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:13:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:13:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:13:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:13:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "266431b4-b49b-4079-b5c7-c0f59f46d201" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:23 user nova-compute[74681]: INFO nova.compute.manager [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Terminating instance
Aug 16 06:13:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-55262e31-fb3f-4469-adfb-8ee648580f92 req-f9e60558-cc6f-4efb-98c3-e74a0aefac5e service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received event network-vif-unplugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-55262e31-fb3f-4469-adfb-8ee648580f92 req-f9e60558-cc6f-4efb-98c3-e74a0aefac5e service nova] Acquiring lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-55262e31-fb3f-4469-adfb-8ee648580f92 req-f9e60558-cc6f-4efb-98c3-e74a0aefac5e service nova] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-55262e31-fb3f-4469-adfb-8ee648580f92 req-f9e60558-cc6f-4efb-98c3-e74a0aefac5e service nova] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-55262e31-fb3f-4469-adfb-8ee648580f92 req-f9e60558-cc6f-4efb-98c3-e74a0aefac5e service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] No waiting events found dispatching network-vif-unplugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-55262e31-fb3f-4469-adfb-8ee648580f92 req-f9e60558-cc6f-4efb-98c3-e74a0aefac5e service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received event network-vif-unplugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:13:24 user nova-compute[74681]: INFO nova.compute.claims [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Claim successful on node user
Aug 16 06:13:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Instance destroyed successfully.
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lazy-loading 'resources' on Instance uuid 266431b4-b49b-4079-b5c7-c0f59f46d201 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:11:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1523144636',display_name='tempest-ServersNegativeTestJSON-server-1523144636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1523144636',id=13,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c4497e1bbb04a6badebffb1fe54b82a',ramdisk_id='',reservation_id='r-t7v9uckb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1958763636',owner_user_name='tempest-ServersNegativeTestJSON-1958763636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:11:42Z,user_data=None,user_id='9f41156e5aac4c49b8d79b28fe9759d9',uuid=266431b4-b49b-4079-b5c7-c0f59f46d201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converting VIF {"id": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "address": "fa:16:3e:da:82:79", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bffd574-62", "ovs_interfaceid": "2bffd574-62c7-4330-b3ba-399d23e34fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:82:79,bridge_name='br-int',has_traffic_filtering=True,id=2bffd574-62c7-4330-b3ba-399d23e34fa4,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bffd574-62') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG os_vif [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:82:79,bridge_name='br-int',has_traffic_filtering=True,id=2bffd574-62c7-4330-b3ba-399d23e34fa4,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bffd574-62') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bffd574-62, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:13:24 user nova-compute[74681]: INFO os_vif [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:82:79,bridge_name='br-int',has_traffic_filtering=True,id=2bffd574-62c7-4330-b3ba-399d23e34fa4,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bffd574-62')
Aug 16 06:13:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Deleting instance files /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201_del
Aug 16 06:13:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Deletion of /opt/stack/data/nova/instances/266431b4-b49b-4079-b5c7-c0f59f46d201_del complete
Aug 16 06:13:24 user nova-compute[74681]: INFO nova.compute.manager [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:13:24 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:13:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:13:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Creating image(s)
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "/opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "/opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.171s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.policy [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd15ba1a73e62426c97713c02fd1c31fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c36ac064a14486eb8673f39338119db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk 1073741824" returned: 0 in 0.045s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:25 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Took 1.01 seconds to deallocate network for instance.
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Cannot resize image /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'migration_context' on Instance uuid 4f6a4167-51f1-4d02-b37b-a031af00ef7b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Ensure instance console log exists: /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Successfully created port: ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:26 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Deleted allocations for instance 266431b4-b49b-4079-b5c7-c0f59f46d201
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-8b3ea42a-bcdb-475f-b175-8e174bb60475 req-36fbc744-5772-4ba0-b1d4-c586d2394e2c service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received event network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8b3ea42a-bcdb-475f-b175-8e174bb60475 req-36fbc744-5772-4ba0-b1d4-c586d2394e2c service nova] Acquiring lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8b3ea42a-bcdb-475f-b175-8e174bb60475 req-36fbc744-5772-4ba0-b1d4-c586d2394e2c service nova] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8b3ea42a-bcdb-475f-b175-8e174bb60475 req-36fbc744-5772-4ba0-b1d4-c586d2394e2c service nova] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-8b3ea42a-bcdb-475f-b175-8e174bb60475 req-36fbc744-5772-4ba0-b1d4-c586d2394e2c service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] No waiting events found dispatching network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:26 user nova-compute[74681]: WARNING nova.compute.manager [req-8b3ea42a-bcdb-475f-b175-8e174bb60475 req-36fbc744-5772-4ba0-b1d4-c586d2394e2c service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received unexpected event network-vif-plugged-2bffd574-62c7-4330-b3ba-399d23e34fa4 for instance with vm_state deleted and task_state None.
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-8b3ea42a-bcdb-475f-b175-8e174bb60475 req-36fbc744-5772-4ba0-b1d4-c586d2394e2c service nova] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Received event network-vif-deleted-2bffd574-62c7-4330-b3ba-399d23e34fa4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d6863f57-e00a-4b6e-972e-c24ff942ef1f tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "266431b4-b49b-4079-b5c7-c0f59f46d201" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Successfully updated port: ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "refresh_cache-4f6a4167-51f1-4d02-b37b-a031af00ef7b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquired lock "refresh_cache-4f6a4167-51f1-4d02-b37b-a031af00ef7b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:13:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Updating instance_info_cache with network_info: [{"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Releasing lock "refresh_cache-4f6a4167-51f1-4d02-b37b-a031af00ef7b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Instance network_info: |[{"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Start _get_guest_xml network_info=[{"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:13:27 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:13:27 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-145353915',display_name='tempest-VolumesAdminNegativeTest-server-145353915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-145353915',id=15,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c36ac064a14486eb8673f39338119db',ramdisk_id='',reservation_id='r-9fg3a9u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-128005769',owner_user_name='tempest-VolumesAdminNegativeTest-128005769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:13:25Z,user_data=None,user_id='d15ba1a73e62426c97713c02fd1c31fb',uuid=4f6a4167-51f1-4d02-b37b-a031af00ef7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converting VIF {"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:cd:97,bridge_name='br-int',has_traffic_filtering=True,id=ba580f27-78aa-49fc-b03b-0169f33ee18b,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba580f27-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f6a4167-51f1-4d02-b37b-a031af00ef7b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:13:27 user nova-compute[74681]:   <uuid>4f6a4167-51f1-4d02-b37b-a031af00ef7b</uuid>
Aug 16 06:13:27 user nova-compute[74681]:   <name>instance-0000000f</name>
Aug 16 06:13:27 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:13:27 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:13:27 user nova-compute[74681]:   <metadata>
Aug 16 06:13:27 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:13:27 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:13:27 user nova-compute[74681]:       <nova:name>tempest-VolumesAdminNegativeTest-server-145353915</nova:name>
Aug 16 06:13:27 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:13:27</nova:creationTime>
Aug 16 06:13:27 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:13:27 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:13:27 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:13:27 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:13:27 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:13:27 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:13:27 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:13:27 user nova-compute[74681]:       <nova:owner>
Aug 16 06:13:27 user nova-compute[74681]:         <nova:user uuid="d15ba1a73e62426c97713c02fd1c31fb">tempest-VolumesAdminNegativeTest-128005769-project-member</nova:user>
Aug 16 06:13:27 user nova-compute[74681]:         <nova:project uuid="5c36ac064a14486eb8673f39338119db">tempest-VolumesAdminNegativeTest-128005769</nova:project>
Aug 16 06:13:27 user nova-compute[74681]:       </nova:owner>
Aug 16 06:13:27 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:13:27 user nova-compute[74681]:       <nova:ports>
Aug 16 06:13:27 user nova-compute[74681]:         <nova:port uuid="ba580f27-78aa-49fc-b03b-0169f33ee18b">
Aug 16 06:13:27 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 06:13:27 user nova-compute[74681]:         </nova:port>
Aug 16 06:13:27 user nova-compute[74681]:       </nova:ports>
Aug 16 06:13:27 user nova-compute[74681]:     </nova:instance>
Aug 16 06:13:27 user nova-compute[74681]:   </metadata>
Aug 16 06:13:27 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:13:27 user nova-compute[74681]:     <system>
Aug 16 06:13:27 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:13:27 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:13:27 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:13:27 user nova-compute[74681]:       <entry name="serial">4f6a4167-51f1-4d02-b37b-a031af00ef7b</entry>
Aug 16 06:13:27 user nova-compute[74681]:       <entry name="uuid">4f6a4167-51f1-4d02-b37b-a031af00ef7b</entry>
Aug 16 06:13:27 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:13:27 user nova-compute[74681]:     </system>
Aug 16 06:13:27 user nova-compute[74681]:   </sysinfo>
Aug 16 06:13:27 user nova-compute[74681]:   <os>
Aug 16 06:13:27 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:13:27 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:13:27 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:13:27 user nova-compute[74681]:   </os>
Aug 16 06:13:27 user nova-compute[74681]:   <features>
Aug 16 06:13:27 user nova-compute[74681]:     <acpi/>
Aug 16 06:13:27 user nova-compute[74681]:     <apic/>
Aug 16 06:13:27 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:13:27 user nova-compute[74681]:   </features>
Aug 16 06:13:27 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:13:27 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:13:27 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:13:27 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:13:27 user nova-compute[74681]:   </clock>
Aug 16 06:13:27 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:13:27 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:13:27 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:13:27 user nova-compute[74681]:   </cpu>
Aug 16 06:13:27 user nova-compute[74681]:   <devices>
Aug 16 06:13:27 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:13:27 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:13:27 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk"/>
Aug 16 06:13:27 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:13:27 user nova-compute[74681]:     </disk>
Aug 16 06:13:27 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:13:27 user nova-compute[74681]:       <mac address="fa:16:3e:61:cd:97"/>
Aug 16 06:13:27 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:13:27 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:13:27 user nova-compute[74681]:       <target dev="tapba580f27-78"/>
Aug 16 06:13:27 user nova-compute[74681]:     </interface>
Aug 16 06:13:27 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:13:27 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/console.log" append="off"/>
Aug 16 06:13:27 user nova-compute[74681]:     </serial>
Aug 16 06:13:27 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:13:27 user nova-compute[74681]:     <video>
Aug 16 06:13:27 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:13:27 user nova-compute[74681]:     </video>
Aug 16 06:13:27 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:13:27 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:13:27 user nova-compute[74681]:     </rng>
Aug 16 06:13:27 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:13:27 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:13:27 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:13:27 user nova-compute[74681]:     </memballoon>
Aug 16 06:13:27 user nova-compute[74681]:   </devices>
Aug 16 06:13:27 user nova-compute[74681]: </domain>
Aug 16 06:13:27 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-145353915',display_name='tempest-VolumesAdminNegativeTest-server-145353915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-145353915',id=15,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c36ac064a14486eb8673f39338119db',ramdisk_id='',reservation_id='r-9fg3a9u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-128005769',owner_user_name='tempest-VolumesAdminNegativeTest-128005769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:13:25Z,user_data=None,user_id='d15ba1a73e62426c97713c02fd1c31fb',uuid=4f6a4167-51f1-4d02-b37b-a031af00ef7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converting VIF {"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:cd:97,bridge_name='br-int',has_traffic_filtering=True,id=ba580f27-78aa-49fc-b03b-0169f33ee18b,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba580f27-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG os_vif [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:cd:97,bridge_name='br-int',has_traffic_filtering=True,id=ba580f27-78aa-49fc-b03b-0169f33ee18b,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba580f27-78') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba580f27-78, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba580f27-78, col_values=(('external_ids', {'iface-id': 'ba580f27-78aa-49fc-b03b-0169f33ee18b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:cd:97', 'vm-uuid': '4f6a4167-51f1-4d02-b37b-a031af00ef7b'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:27 user nova-compute[74681]: INFO os_vif [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:cd:97,bridge_name='br-int',has_traffic_filtering=True,id=ba580f27-78aa-49fc-b03b-0169f33ee18b,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba580f27-78')
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:13:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] No VIF found with MAC fa:16:3e:61:cd:97, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-b3897023-1f02-46ef-a5af-34533491210e req-04a5e1be-85c7-4c33-bcbd-960e83cbcae2 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received event network-changed-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-b3897023-1f02-46ef-a5af-34533491210e req-04a5e1be-85c7-4c33-bcbd-960e83cbcae2 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Refreshing instance network info cache due to event network-changed-ba580f27-78aa-49fc-b03b-0169f33ee18b. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b3897023-1f02-46ef-a5af-34533491210e req-04a5e1be-85c7-4c33-bcbd-960e83cbcae2 service nova] Acquiring lock "refresh_cache-4f6a4167-51f1-4d02-b37b-a031af00ef7b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b3897023-1f02-46ef-a5af-34533491210e req-04a5e1be-85c7-4c33-bcbd-960e83cbcae2 service nova] Acquired lock "refresh_cache-4f6a4167-51f1-4d02-b37b-a031af00ef7b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-b3897023-1f02-46ef-a5af-34533491210e req-04a5e1be-85c7-4c33-bcbd-960e83cbcae2 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Refreshing network info cache for port ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-b3897023-1f02-46ef-a5af-34533491210e req-04a5e1be-85c7-4c33-bcbd-960e83cbcae2 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Updated VIF entry in instance network info cache for port ba580f27-78aa-49fc-b03b-0169f33ee18b. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-b3897023-1f02-46ef-a5af-34533491210e req-04a5e1be-85c7-4c33-bcbd-960e83cbcae2 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Updating instance_info_cache with network_info: [{"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b3897023-1f02-46ef-a5af-34533491210e req-04a5e1be-85c7-4c33-bcbd-960e83cbcae2 service nova] Releasing lock "refresh_cache-4f6a4167-51f1-4d02-b37b-a031af00ef7b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received event network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] Acquiring lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] No waiting events found dispatching network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:30 user nova-compute[74681]: WARNING nova.compute.manager [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received unexpected event network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b for instance with vm_state building and task_state spawning.
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received event network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] Acquiring lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] No waiting events found dispatching network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:30 user nova-compute[74681]: WARNING nova.compute.manager [req-59fdd8f8-5bde-456e-9fc5-bb5bac722a5b req-9ee98f9f-b8a3-4604-bdac-f621158811d1 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received unexpected event network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b for instance with vm_state building and task_state spawning.
Aug 16 06:13:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166410.8335123, 4f6a4167-51f1-4d02-b37b-a031af00ef7b => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:13:30 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] VM Resumed (Lifecycle Event)
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:13:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Instance spawned successfully.
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:13:30 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166410.8355012, 4f6a4167-51f1-4d02-b37b-a031af00ef7b => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:13:30 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] VM Started (Lifecycle Event)
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:13:30 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:13:30 user nova-compute[74681]: INFO nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 16 06:13:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:13:31 user nova-compute[74681]: INFO nova.compute.manager [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Took 6.69 seconds to build instance.
Aug 16 06:13:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2c6e9ad0-4743-4208-a5dd-c202d02cf825 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.793s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:33 user nova-compute[74681]: INFO nova.compute.manager [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Terminating instance
Aug 16 06:13:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-e95f5d35-6aa4-457b-8b88-e8cc8272551e req-3140f613-8e91-424f-b06e-8587734bb0b1 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-unplugged-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e95f5d35-6aa4-457b-8b88-e8cc8272551e req-3140f613-8e91-424f-b06e-8587734bb0b1 service nova] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e95f5d35-6aa4-457b-8b88-e8cc8272551e req-3140f613-8e91-424f-b06e-8587734bb0b1 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e95f5d35-6aa4-457b-8b88-e8cc8272551e req-3140f613-8e91-424f-b06e-8587734bb0b1 service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-e95f5d35-6aa4-457b-8b88-e8cc8272551e req-3140f613-8e91-424f-b06e-8587734bb0b1 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] No waiting events found dispatching network-vif-unplugged-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-e95f5d35-6aa4-457b-8b88-e8cc8272551e req-3140f613-8e91-424f-b06e-8587734bb0b1 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-unplugged-3627db91-9415-4563-b459-d2b461b3c470 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Instance destroyed successfully.
Aug 16 06:13:34 user nova-compute[74681]: DEBUG nova.objects.instance [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lazy-loading 'resources' on Instance uuid 76acb01b-43fd-4a5b-990d-ee95e09aeeab {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1139632821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1139632821',id=7,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBAqdu23APakPluX2/Wwu20nq64GkdpAkGd1ClAWQPERSlK6QgtCz3K0uQRSJ8S1fk1rlhGB0V8lrqTWHbX+6NkFsPdjicHFGW4I/cBtktPv2EAAIPjOM9oekXGmE4xdA==',key_name='tempest-keypair-1290247171',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85a954b5814d46929acbbfbc993c73a3',ramdisk_id='',reservation_id='r-vglyditn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1137660729',owner_user_name='tempest-TaggedAttachmentsTest-1137660729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9edd2fb688ff4a44b33af0ae3a358f53',uuid=76acb01b-43fd-4a5b-990d-ee95e09aeeab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converting VIF {"id": "3627db91-9415-4563-b459-d2b461b3c470", "address": "fa:16:3e:b1:d3:83", "network": {"id": "7697659e-f313-4a47-8a93-bc3a1b5d39a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1985916676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85a954b5814d46929acbbfbc993c73a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3627db91-94", "ovs_interfaceid": "3627db91-9415-4563-b459-d2b461b3c470", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d3:83,bridge_name='br-int',has_traffic_filtering=True,id=3627db91-9415-4563-b459-d2b461b3c470,network=Network(7697659e-f313-4a47-8a93-bc3a1b5d39a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3627db91-94') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG os_vif [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d3:83,bridge_name='br-int',has_traffic_filtering=True,id=3627db91-9415-4563-b459-d2b461b3c470,network=Network(7697659e-f313-4a47-8a93-bc3a1b5d39a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3627db91-94') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3627db91-94, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:13:34 user nova-compute[74681]: INFO os_vif [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:d3:83,bridge_name='br-int',has_traffic_filtering=True,id=3627db91-9415-4563-b459-d2b461b3c470,network=Network(7697659e-f313-4a47-8a93-bc3a1b5d39a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3627db91-94')
Aug 16 06:13:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Deleting instance files /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab_del
Aug 16 06:13:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Deletion of /opt/stack/data/nova/instances/76acb01b-43fd-4a5b-990d-ee95e09aeeab_del complete
Aug 16 06:13:34 user nova-compute[74681]: INFO nova.compute.manager [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 06:13:34 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:34 user nova-compute[74681]: INFO nova.compute.manager [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Terminating instance
Aug 16 06:13:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-97f50b50-9e9d-4543-847f-d4d394a9db22 req-562cef81-171a-4c00-be60-6dd90f256776 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received event network-vif-unplugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-97f50b50-9e9d-4543-847f-d4d394a9db22 req-562cef81-171a-4c00-be60-6dd90f256776 service nova] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-97f50b50-9e9d-4543-847f-d4d394a9db22 req-562cef81-171a-4c00-be60-6dd90f256776 service nova] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-97f50b50-9e9d-4543-847f-d4d394a9db22 req-562cef81-171a-4c00-be60-6dd90f256776 service nova] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-97f50b50-9e9d-4543-847f-d4d394a9db22 req-562cef81-171a-4c00-be60-6dd90f256776 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] No waiting events found dispatching network-vif-unplugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-97f50b50-9e9d-4543-847f-d4d394a9db22 req-562cef81-171a-4c00-be60-6dd90f256776 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received event network-vif-unplugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:35 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Took 0.96 seconds to deallocate network for instance.
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-b3f5a439-12ce-4425-97e9-dc95627639c6 req-ecf3e17c-8192-4b11-9d4f-dc967acf7c45 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-deleted-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:35 user nova-compute[74681]: INFO nova.compute.manager [req-b3f5a439-12ce-4425-97e9-dc95627639c6 req-ecf3e17c-8192-4b11-9d4f-dc967acf7c45 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Neutron deleted interface 3627db91-9415-4563-b459-d2b461b3c470; detaching it from the instance and deleting it from the info cache
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.network.neutron [req-b3f5a439-12ce-4425-97e9-dc95627639c6 req-ecf3e17c-8192-4b11-9d4f-dc967acf7c45 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-b3f5a439-12ce-4425-97e9-dc95627639c6 req-ecf3e17c-8192-4b11-9d4f-dc967acf7c45 service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Detach interface failed, port_id=3627db91-9415-4563-b459-d2b461b3c470, reason: Instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Instance destroyed successfully.
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lazy-loading 'resources' on Instance uuid 2f74fd47-e29b-4392-9af3-eabed0d91993 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1568385333',display_name='tempest-VolumesAssistedSnapshotsTest-server-1568385333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1568385333',id=10,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEWD6oDRMn6gQdfdq+KDNHUKkwjbaQuw7Wyq7reKkaZtl5tl0TFzolnovLTcqnHGeq3YhGNHjSsqzMsAj4aWa18X7R0DpUdNrBy3x6DKwgUYdy/Vaehp+HJyb61laj18Q==',key_name='tempest-keypair-942216464',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90b9899e5b2c4c208197b432e42dff8a',ramdisk_id='',reservation_id='r-voo5wexh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-759327546',owner_user_name='tempest-VolumesAssistedSnapshotsTest-759327546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='786261495dab40028aba9ec701354abf',uuid=2f74fd47-e29b-4392-9af3-eabed0d91993,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Converting VIF {"id": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "address": "fa:16:3e:a4:d5:10", "network": {"id": "4c91a2af-8b00-4d9a-98ed-818167e395ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1269062186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90b9899e5b2c4c208197b432e42dff8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b07c78-fa", "ovs_interfaceid": "f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f,network=Network(4c91a2af-8b00-4d9a-98ed-818167e395ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b07c78-fa') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG os_vif [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f,network=Network(4c91a2af-8b00-4d9a-98ed-818167e395ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b07c78-fa') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4b07c78-fa, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:13:35 user nova-compute[74681]: INFO os_vif [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d5:10,bridge_name='br-int',has_traffic_filtering=True,id=f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f,network=Network(4c91a2af-8b00-4d9a-98ed-818167e395ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b07c78-fa')
Aug 16 06:13:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Deleting instance files /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993_del
Aug 16 06:13:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Deletion of /opt/stack/data/nova/instances/2f74fd47-e29b-4392-9af3-eabed0d91993_del complete
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:13:35 user nova-compute[74681]: INFO nova.compute.manager [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-b7c62447-1ba5-4f74-a3f4-6e12a891e125 req-0caba67d-0d5d-45ca-8301-e441d1762fcb service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received event network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b7c62447-1ba5-4f74-a3f4-6e12a891e125 req-0caba67d-0d5d-45ca-8301-e441d1762fcb service nova] Acquiring lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b7c62447-1ba5-4f74-a3f4-6e12a891e125 req-0caba67d-0d5d-45ca-8301-e441d1762fcb service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b7c62447-1ba5-4f74-a3f4-6e12a891e125 req-0caba67d-0d5d-45ca-8301-e441d1762fcb service nova] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-b7c62447-1ba5-4f74-a3f4-6e12a891e125 req-0caba67d-0d5d-45ca-8301-e441d1762fcb service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] No waiting events found dispatching network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:35 user nova-compute[74681]: WARNING nova.compute.manager [req-b7c62447-1ba5-4f74-a3f4-6e12a891e125 req-0caba67d-0d5d-45ca-8301-e441d1762fcb service nova] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Received unexpected event network-vif-plugged-3627db91-9415-4563-b459-d2b461b3c470 for instance with vm_state deleted and task_state None.
Aug 16 06:13:36 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Deleted allocations for instance 76acb01b-43fd-4a5b-990d-ee95e09aeeab
Aug 16 06:13:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4af26e39-c181-4b13-a593-2f17a5489ec2 tempest-TaggedAttachmentsTest-1137660729 tempest-TaggedAttachmentsTest-1137660729-project-member] Lock "76acb01b-43fd-4a5b-990d-ee95e09aeeab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.628s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:36 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:36 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Took 0.88 seconds to deallocate network for instance.
Aug 16 06:13:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-707c65ca-0ea5-43a8-b681-5fd4b568994c req-7a9c9d9d-3e8d-4987-9731-b2ec84df73e0 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received event network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-707c65ca-0ea5-43a8-b681-5fd4b568994c req-7a9c9d9d-3e8d-4987-9731-b2ec84df73e0 service nova] Acquiring lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-707c65ca-0ea5-43a8-b681-5fd4b568994c req-7a9c9d9d-3e8d-4987-9731-b2ec84df73e0 service nova] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-707c65ca-0ea5-43a8-b681-5fd4b568994c req-7a9c9d9d-3e8d-4987-9731-b2ec84df73e0 service nova] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-707c65ca-0ea5-43a8-b681-5fd4b568994c req-7a9c9d9d-3e8d-4987-9731-b2ec84df73e0 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] No waiting events found dispatching network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:37 user nova-compute[74681]: WARNING nova.compute.manager [req-707c65ca-0ea5-43a8-b681-5fd4b568994c req-7a9c9d9d-3e8d-4987-9731-b2ec84df73e0 service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received unexpected event network-vif-plugged-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f for instance with vm_state deleted and task_state None.
Aug 16 06:13:37 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:13:37 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:13:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-1389d1ad-cfb9-4bf6-8a62-183814527bbe req-7894ccad-4033-40f6-921a-065a7304aa1b service nova] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Received event network-vif-deleted-f4b07c78-fa0f-4aa2-bd2b-50ea26f30c9f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.605s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:37 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Deleted allocations for instance 2f74fd47-e29b-4392-9af3-eabed0d91993
Aug 16 06:13:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce385a15-8af9-4de9-8531-dbe5967bcb3f tempest-VolumesAssistedSnapshotsTest-759327546 tempest-VolumesAssistedSnapshotsTest-759327546-project-member] Lock "2f74fd47-e29b-4392-9af3-eabed0d91993" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'flavor' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.160s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:38 user nova-compute[74681]: INFO nova.compute.manager [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Attaching volume fa0fc499-46b6-44aa-aa5a-76069df747f8 to /dev/vdb
Aug 16 06:13:38 user nova-compute[74681]: DEBUG os_brick.utils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5215e6-f195-4f91-8b6f-69b975bdd0dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a8f03f-783e-421a-80af-f07c871a67e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb56ab-6fe2-4e4c-b75a-1c3418e57b48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa15bb9-c04d-4756-b040-fd815f890188]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:13:39 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccff221-84a0-4b05-8eb0-a8245013c226]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.utils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating existing volume attachment record: e374d96f-55d4-4d62-aafc-cd106de5fab7 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lazy-loading 'flavor' on Instance uuid 70390b89-fdfb-4552-98e5-35568c0268bc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166404.53775, 266431b4-b49b-4079-b5c7-c0f59f46d201 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:13:39 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] VM Stopped (Lifecycle Event)
Aug 16 06:13:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cf8f8776-f0eb-46bc-80ae-a0907a5d3ccd None None] [instance: 266431b4-b49b-4079-b5c7-c0f59f46d201] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:39 user nova-compute[74681]: INFO nova.compute.manager [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Attaching volume 66993ddf-9c38-4482-8dd6-cbb00ade162f to /dev/vdb
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.utils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e212506-0291-4b69-8d57-3e8f65cc9b1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[359dd685-e636-462f-b5f1-5874f37a652b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba25c1-2e3f-46ce-a431-91b9e1266349]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c5e1bc-260a-450f-8cab-14fe8635c8aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:13:39 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:13:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfd75bd-b2df-4734-bac6-1379d529e9ea]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG os_brick.utils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:39 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating existing volume attachment record: 989e6f53-b5b2-4ddc-a019-1f7cdc4b1a09 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:13:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:41 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:13:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7199MB free_disk=25.715030670166016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3fa19b27-7628-44ce-b0ae-e1e870337855 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 70390b89-fdfb-4552-98e5-35568c0268bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance d7bc97ea-3b81-488c-8c63-b83a351118d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 9791d36b-9111-47c7-aa6d-c86645e1a453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ff2064c1-e1bb-4abe-ab33-ced79efbeadc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance c3c07afb-5fb6-456d-a631-028e7c817b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4f6a4167-51f1-4d02-b37b-a031af00ef7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:13:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:13:46 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:13:46 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:13:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:13:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:48 user nova-compute[74681]: INFO nova.compute.manager [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Unshelving
Aug 16 06:13:48 user nova-compute[74681]: INFO nova.virt.block_device [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Booting with volume 1842ce72-883c-462a-be3c-2823df2e854b at /dev/vdc
Aug 16 06:13:48 user nova-compute[74681]: DEBUG os_brick.utils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ef18b9-cb67-49de-8d84-b6e34c33632e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d449c2-85f7-4fa0-95a8-13431fa201ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b048f8f8-4c88-4a09-abae-08e3a9fb5c4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e048b1-96f3-47ec-839d-71c0ef5d456d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:13:48 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:13:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[590403a6-dcf9-4cf7-a925-77829d25dbb2]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG os_brick.utils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:48 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating existing volume attachment record: dcd15f36-e061-4ccd-8c5e-9872ffad63dd {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166414.3128548, 76acb01b-43fd-4a5b-990d-ee95e09aeeab => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:13:49 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] VM Stopped (Lifecycle Event)
Aug 16 06:13:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3c6f29a0-ba59-463e-b1d3-caad1e399a6a None None] [instance: 76acb01b-43fd-4a5b-990d-ee95e09aeeab] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pklLIHiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:49 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:49 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:49 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[045edfea-2cd5-43ad-9dff-edd19dd17647]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:13:49 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[af66b801-50a1-415f-8d43-5dc8383b9a47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8] added
Aug 16 06:13:49 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[517a1893-d0e8-4da6-b40d-63bd7472c954]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b91581b-53c4-4fcd-8829-bfd6d4035817]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pklLIHiX {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pklLIHiX" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414d324-db5b-404e-905e-9d9a37575f0e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pklLIHiX'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[24633bc8-b088-4cda-90d6-7fb9fd5f96a0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[459ce4be-9aee-48d8-89f6-2bdd006b5784]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de5b30c-ee24-4f16-9924-f4186803019a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8, portal: 172.16.0.220,3260]
Aug 16 06:13:50 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8, portal: 172.16.0.220,3260] successful.
Aug 16 06:13:50 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15ddfc6-619b-41b8-a6d3-a550dc5da117]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7253d37c-16aa-445d-9930-265b56698e71]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:50 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:50 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d523e-92a6-4155-aef4-953dc76a3f36]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pklLIHiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVgzeHyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:50 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:50 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166415.7944627, 2f74fd47-e29b-4392-9af3-eabed0d91993 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:13:50 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] VM Stopped (Lifecycle Event)
Aug 16 06:13:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8c44e8f8-8aad-4f7a-9a33-f2f74e515422 None None] [instance: 2f74fd47-e29b-4392-9af3-eabed0d91993] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:13:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23632353866313564', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632353866313564', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.913s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:51 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:51 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'flavor' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff72cb-b712-4b5f-b48e-0c697a3ef9f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:13:51 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:13:51 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:13:51 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:13:51 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:13:51 user nova-compute[74681]:   <serial>fa0fc499-46b6-44aa-aa5a-76069df747f8</serial>
Aug 16 06:13:51 user nova-compute[74681]: </disk>
Aug 16 06:13:51 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8a58a8-06a9-4104-9de2-1c5dcf111b9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f] added
Aug 16 06:13:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3b9efa-5221-4e1a-b65d-3bbc5f97c8e3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7a0957-3644-4e50-a930-4af14aadb10e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVgzeHyP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVgzeHyP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8de028-7e23-40d3-a73e-fb35e22b8db0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVgzeHyP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa4a8bf-e7a0-47b7-b986-052fcf62d4d5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2981f6-49b0-4f58-b3a5-83092ae29739]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6514c85-1575-46c1-b091-067eafb94252]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f, portal: 172.16.0.220,3260]
Aug 16 06:13:51 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f, portal: 172.16.0.220,3260] successful.
Aug 16 06:13:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bce2590-2a4a-4a45-ab57-ca0b2313ec9e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f7f2cf-4ff2-4c9c-95f2-00b4a4c676ff]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:51 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] HCTL ('41', '-', '-', 0) found on session 17 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[890afb04-f91b-4686-9717-7ed6cba754ed]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Searching for a device in session 17 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVgzeHyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No VIF found with MAC fa:16:3e:b1:69:e0, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:13:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8950822e-e954-4d78-93db-15d148e89855 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.960s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:52 user nova-compute[74681]: INFO nova.compute.manager [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Rescuing
Aug 16 06:13:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquired lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-950031df-36c0-4f15-a6c1-e269845cf472 req-975cd357-38c1-43f7-8057-0f36c93c4f57 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received event network-changed-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-950031df-36c0-4f15-a6c1-e269845cf472 req-975cd357-38c1-43f7-8057-0f36c93c4f57 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Refreshing instance network info cache due to event network-changed-9fea00bc-cee5-48a3-9054-a1d314875c80. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-950031df-36c0-4f15-a6c1-e269845cf472 req-975cd357-38c1-43f7-8057-0f36c93c4f57 service nova] Acquiring lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-950031df-36c0-4f15-a6c1-e269845cf472 req-975cd357-38c1-43f7-8057-0f36c93c4f57 service nova] Acquired lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG nova.network.neutron [req-950031df-36c0-4f15-a6c1-e269845cf472 req-975cd357-38c1-43f7-8057-0f36c93c4f57 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Refreshing network info cache for port 9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] <== connect_volume: return (2316ms) {'type': 'block', 'scsi_wwn': '26565373062616363', 'path': '/dev/sdj'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565373062616363', 'path': '/dev/sdj'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lazy-loading 'flavor' on Instance uuid 70390b89-fdfb-4552-98e5-35568c0268bc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:13:52 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:13:52 user nova-compute[74681]:   <source dev="/dev/sdj"/>
Aug 16 06:13:52 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:13:52 user nova-compute[74681]:   <serial>66993ddf-9c38-4482-8dd6-cbb00ade162f</serial>
Aug 16 06:13:52 user nova-compute[74681]: </disk>
Aug 16 06:13:52 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] No VIF found with MAC fa:16:3e:95:96:98, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fa572137-9fd3-4a40-9fd4-93a6c6edc1aa tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.663s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "c3c07afb-5fb6-456d-a631-028e7c817b23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:53 user nova-compute[74681]: INFO nova.compute.manager [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Terminating instance
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Releasing lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.network.neutron [req-950031df-36c0-4f15-a6c1-e269845cf472 req-975cd357-38c1-43f7-8057-0f36c93c4f57 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Updated VIF entry in instance network info cache for port 9fea00bc-cee5-48a3-9054-a1d314875c80. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.network.neutron [req-950031df-36c0-4f15-a6c1-e269845cf472 req-975cd357-38c1-43f7-8057-0f36c93c4f57 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Updating instance_info_cache with network_info: [{"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-950031df-36c0-4f15-a6c1-e269845cf472 req-975cd357-38c1-43f7-8057-0f36c93c4f57 service nova] Releasing lock "refresh_cache-c3c07afb-5fb6-456d-a631-028e7c817b23" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-8c99f912-3cfb-47e3-8cbc-4fc77b7234e8 req-4f61fd6c-8b0a-41fd-b926-b7dfcb8c48b3 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received event network-vif-unplugged-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8c99f912-3cfb-47e3-8cbc-4fc77b7234e8 req-4f61fd6c-8b0a-41fd-b926-b7dfcb8c48b3 service nova] Acquiring lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8c99f912-3cfb-47e3-8cbc-4fc77b7234e8 req-4f61fd6c-8b0a-41fd-b926-b7dfcb8c48b3 service nova] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8c99f912-3cfb-47e3-8cbc-4fc77b7234e8 req-4f61fd6c-8b0a-41fd-b926-b7dfcb8c48b3 service nova] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-8c99f912-3cfb-47e3-8cbc-4fc77b7234e8 req-4f61fd6c-8b0a-41fd-b926-b7dfcb8c48b3 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] No waiting events found dispatching network-vif-unplugged-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-8c99f912-3cfb-47e3-8cbc-4fc77b7234e8 req-4f61fd6c-8b0a-41fd-b926-b7dfcb8c48b3 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received event network-vif-unplugged-9fea00bc-cee5-48a3-9054-a1d314875c80 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:13:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Instance destroyed successfully.
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'resources' on Instance uuid c3c07afb-5fb6-456d-a631-028e7c817b23 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-283614017',display_name='tempest-AttachVolumeNegativeTest-server-283614017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-283614017',id=14,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADo/76orKLVnZUZGrDmFQlznNYnoVMxsUE3yYyGg/1znTGDQ7tIgp4Ifc91mGU95ca/ltPX6ZJvl+Nibymbi/HCasbNclvZ8DiN8zK/jdbapRpmE2BlYN1ZyM/EEDy3ww==',key_name='tempest-keypair-906521259',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-nukys89k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=c3c07afb-5fb6-456d-a631-028e7c817b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "9fea00bc-cee5-48a3-9054-a1d314875c80", "address": "fa:16:3e:cd:51:6f", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fea00bc-ce", "ovs_interfaceid": "9fea00bc-cee5-48a3-9054-a1d314875c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:51:6f,bridge_name='br-int',has_traffic_filtering=True,id=9fea00bc-cee5-48a3-9054-a1d314875c80,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fea00bc-ce') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG os_vif [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:51:6f,bridge_name='br-int',has_traffic_filtering=True,id=9fea00bc-cee5-48a3-9054-a1d314875c80,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fea00bc-ce') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fea00bc-ce, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.compute.manager [req-b7387d52-3cd7-4f3e-b79f-0b0fc1167b1e req-7463dcda-7988-4a94-ba9c-c3edd352a30f service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b7387d52-3cd7-4f3e-b79f-0b0fc1167b1e req-7463dcda-7988-4a94-ba9c-c3edd352a30f service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b7387d52-3cd7-4f3e-b79f-0b0fc1167b1e req-7463dcda-7988-4a94-ba9c-c3edd352a30f service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b7387d52-3cd7-4f3e-b79f-0b0fc1167b1e req-7463dcda-7988-4a94-ba9c-c3edd352a30f service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.compute.manager [req-b7387d52-3cd7-4f3e-b79f-0b0fc1167b1e req-7463dcda-7988-4a94-ba9c-c3edd352a30f service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:54 user nova-compute[74681]: WARNING nova.compute.manager [req-b7387d52-3cd7-4f3e-b79f-0b0fc1167b1e req-7463dcda-7988-4a94-ba9c-c3edd352a30f service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state active and task_state rescuing.
Aug 16 06:13:54 user nova-compute[74681]: INFO os_vif [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:51:6f,bridge_name='br-int',has_traffic_filtering=True,id=9fea00bc-cee5-48a3-9054-a1d314875c80,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fea00bc-ce')
Aug 16 06:13:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Deleting instance files /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23_del
Aug 16 06:13:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Deletion of /opt/stack/data/nova/instances/c3c07afb-5fb6-456d-a631-028e7c817b23_del complete
Aug 16 06:13:54 user nova-compute[74681]: INFO nova.compute.manager [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:13:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance destroyed successfully.
Aug 16 06:13:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Attempting a stable device rescue
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74681) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance directory exists: not creating {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 06:13:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Creating image(s)
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'trusted_certs' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "dc97c7410e961943814bdccd7ce285d418577439" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "dc97c7410e961943814bdccd7ce285d418577439" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:55 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Took 1.42 seconds to deallocate network for instance.
Aug 16 06:13:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Stashing vm_state: active {{(pid=74681) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-7e68b5a7-390d-4475-83b6-f7037cf1e510 req-6ad9fe03-50b6-498f-ac8b-400ff6deb268 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received event network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e68b5a7-390d-4475-83b6-f7037cf1e510 req-6ad9fe03-50b6-498f-ac8b-400ff6deb268 service nova] Acquiring lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e68b5a7-390d-4475-83b6-f7037cf1e510 req-6ad9fe03-50b6-498f-ac8b-400ff6deb268 service nova] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e68b5a7-390d-4475-83b6-f7037cf1e510 req-6ad9fe03-50b6-498f-ac8b-400ff6deb268 service nova] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-7e68b5a7-390d-4475-83b6-f7037cf1e510 req-6ad9fe03-50b6-498f-ac8b-400ff6deb268 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] No waiting events found dispatching network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:55 user nova-compute[74681]: WARNING nova.compute.manager [req-7e68b5a7-390d-4475-83b6-f7037cf1e510 req-6ad9fe03-50b6-498f-ac8b-400ff6deb268 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received unexpected event network-vif-plugged-9fea00bc-cee5-48a3-9054-a1d314875c80 for instance with vm_state active and task_state deleting.
Aug 16 06:13:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-7e68b5a7-390d-4475-83b6-f7037cf1e510 req-6ad9fe03-50b6-498f-ac8b-400ff6deb268 service nova] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Received event network-vif-deleted-9fea00bc-cee5-48a3-9054-a1d314875c80 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:55 user nova-compute[74681]: DEBUG nova.virt.images [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] 44e91125-d430-417c-a86f-f2b7b1af7cac was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439.part /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.compute.manager [req-897cbaca-5720-48cc-aa53-0f244be13984 req-17ae575f-68e2-477b-89c1-9baacc253e99 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-897cbaca-5720-48cc-aa53-0f244be13984 req-17ae575f-68e2-477b-89c1-9baacc253e99 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-897cbaca-5720-48cc-aa53-0f244be13984 req-17ae575f-68e2-477b-89c1-9baacc253e99 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-897cbaca-5720-48cc-aa53-0f244be13984 req-17ae575f-68e2-477b-89c1-9baacc253e99 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.compute.manager [req-897cbaca-5720-48cc-aa53-0f244be13984 req-17ae575f-68e2-477b-89c1-9baacc253e99 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:56 user nova-compute[74681]: WARNING nova.compute.manager [req-897cbaca-5720-48cc-aa53-0f244be13984 req-17ae575f-68e2-477b-89c1-9baacc253e99 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state active and task_state rescuing.
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439.part /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439.converted" returned: 0 in 0.588s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.841s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.327s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "dc97c7410e961943814bdccd7ce285d418577439" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.082s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "dc97c7410e961943814bdccd7ce285d418577439" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "dc97c7410e961943814bdccd7ce285d418577439" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:56 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Deleted allocations for instance c3c07afb-5fb6-456d-a631-028e7c817b23
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lazy-loading 'pci_requests' on Instance uuid 70390b89-fdfb-4552-98e5-35568c0268bc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:13:56 user nova-compute[74681]: INFO nova.compute.claims [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Claim successful on node user
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lazy-loading 'resources' on Instance uuid 70390b89-fdfb-4552-98e5-35568c0268bc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lazy-loading 'pci_devices' on Instance uuid 70390b89-fdfb-4552-98e5-35568c0268bc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:57 user nova-compute[74681]: INFO nova.compute.resource_tracker [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating resource usage from migration 2e109d1c-ba77-4e53-a8f8-82b6cc6e64bb
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439 --force-share --output=json" returned: 0 in 0.195s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439,backing_fmt=raw /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8062d9ca-b68d-4d38-b022-c39a82a7dfa5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "c3c07afb-5fb6-456d-a631-028e7c817b23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.667s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439,backing_fmt=raw /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue" returned: 0 in 0.064s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "dc97c7410e961943814bdccd7ce285d418577439" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'migration_context' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Start _get_guest_xml network_info=[{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "vif_mac": "fa:16:3e:b1:69:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '44e91125-d430-417c-a86f-f2b7b1af7cac', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'e374d96f-55d4-4d62-aafc-cd106de5fab7', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pklLIHiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd7bc97ea-3b81-488c-8c63-b83a351118d2', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa0fc499-46b6-44aa-aa5a-76069df747f8', 'serial': 'fa0fc499-46b6-44aa-aa5a-76069df747f8'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'resources' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'numa_topology' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:57 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:13:57 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pklLIHiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:57 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:57 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:57 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9058a4e6-eeb1-4f66-b24a-9b122441f11f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pklLIHiX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 06:13:57 user nova-compute[74681]: node.name = iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8
Aug 16 06:13:57 user nova-compute[74681]: node.tpgt = -1
Aug 16 06:13:57 user nova-compute[74681]: node.startup = automatic
Aug 16 06:13:57 user nova-compute[74681]: node.leading_login = No
Aug 16 06:13:57 user nova-compute[74681]: iface.iscsi_ifacename = default
Aug 16 06:13:57 user nova-compute[74681]: iface.net_ifacename = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.ipaddress = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.prefix_len = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.hwaddress = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.transport_name = tcp
Aug 16 06:13:57 user nova-compute[74681]: iface.initiatorname = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.state = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.vlan_id = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.vlan_priority = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.vlan_state = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.iface_num = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.mtu = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.port = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.bootproto = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.subnet_mask = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.gateway = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.dhcp_alt_client_id = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.dhcp_dns = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.dhcp_learn_iqn = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.dhcp_vendor_id_state = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.dhcp_vendor_id = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.dhcp_slp_da = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.fragmentation = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.gratuitous_arp = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.incoming_forwarding = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.tos_state = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.tos = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.ttl = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.delayed_ack = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.tcp_nagle = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.tcp_wsf_state = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.tcp_wsf = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.tcp_timer_scale = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.tcp_timestamp = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.redirect = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.def_task_mgmt_timeout = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.header_digest = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.data_digest = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.immediate_data = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.initial_r2t = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.data_seq_inorder = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.data_pdu_inorder = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.erl = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.max_receive_data_len = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.first_burst_len = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.max_outstanding_r2t = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.max_burst_len = 0
Aug 16 06:13:57 user nova-compute[74681]: iface.chap_auth = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.bidi_chap = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.strict_login_compliance = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.discovery_auth = <empty>
Aug 16 06:13:57 user nova-compute[74681]: iface.discovery_logout = <empty>
Aug 16 06:13:57 user nova-compute[74681]: node.discovery_address = <empty>
Aug 16 06:13:57 user nova-compute[74681]: node.discovery_port = 0
Aug 16 06:13:57 user nova-compute[74681]: node.discovery_type = static
Aug 16 06:13:57 user nova-compute[74681]: node.session.initial_cmdsn = 0
Aug 16 06:13:57 user nova-compute[74681]: node.session.initial_login_retry_max = 8
Aug 16 06:13:57 user nova-compute[74681]: node.session.xmit_thread_priority = -20
Aug 16 06:13:57 user nova-compute[74681]: node.session.cmds_max = 128
Aug 16 06:13:57 user nova-compute[74681]: node.session.queue_depth = 32
Aug 16 06:13:57 user nova-compute[74681]: node.session.nr_sessions = 1
Aug 16 06:13:57 user nova-compute[74681]: node.session.auth.authmethod = CHAP
Aug 16 06:13:57 user nova-compute[74681]: node.session.auth.username = pklLIHiX
Aug 16 06:13:57 user nova-compute[74681]: node.session.auth.password = ***
Aug 16 06:13:57 user nova-compute[74681]: node.session.auth.username_in = <empty>
Aug 16 06:13:57 user nova-compute[74681]: node.session.auth.password_in = <empty>
Aug 16 06:13:57 user nova-compute[74681]: node.session.auth.chap_algs = MD5
Aug 16 06:13:57 user nova-compute[74681]: node.session.timeo.replacement_timeout = 120
Aug 16 06:13:57 user nova-compute[74681]: node.session.err_timeo.abort_timeout = 15
Aug 16 06:13:57 user nova-compute[74681]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 06:13:57 user nova-compute[74681]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 06:13:57 user nova-compute[74681]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.FastAbort = Yes
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.InitialR2T = No
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.ImmediateData = Yes
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.MaxConnections = 1
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 06:13:57 user nova-compute[74681]: node.session.iscsi.ERL = 0
Aug 16 06:13:57 user nova-compute[74681]: node.session.scan = manual
Aug 16 06:13:57 user nova-compute[74681]: node.session.reopen_max = 0
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].address = 172.16.0.220
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].port = 3260
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].startup = manual
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].tcp.window_size = 524288
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].tcp.type_of_service = 0
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].timeo.logout_timeout = 15
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].timeo.login_timeout = 15
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].timeo.auth_timeout = 45
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].iscsi.DataDigest = None
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].iscsi.IFMarker = No
Aug 16 06:13:57 user nova-compute[74681]: node.conn[0].iscsi.OFMarker = No
Aug 16 06:13:57 user nova-compute[74681]: # END RECORD
Aug 16 06:13:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fed602-18c2-4bce-bd30-e36d1b6500d7]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec95758-35a2-4c5d-a107-90b0c8d39243]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pklLIHiX {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pklLIHiX" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bed33c-4f06-4f42-a8cf-33b24da8f646]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pklLIHiX'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[254a6c23-73a0-468b-91df-97a95a198f76]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc94d6e9-7936-4788-ac92-a0cd3661ea9d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:57 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] HCTL ('37', '0', '0', 0) found on session 16 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[125b7ec3-8c7d-45d4-a807-4b868d3a7501]: (4, ('0 0 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Searching for a device in session 16 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pklLIHiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] <== connect_volume: return (214ms) {'type': 'block', 'scsi_wwn': '23632353866313564', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632353866313564', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.627s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:57 user nova-compute[74681]: INFO nova.compute.manager [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Migrating
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:13:57 user nova-compute[74681]: INFO nova.compute.rpcapi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1131256241',display_name='tempest-ServerStableDeviceRescueTest-server-1131256241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1131256241',id=4,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA5jr45P5sA8Q8jIF9YaPdfYu6PFHw4mwN8Wy/fnGh6GDyiFgbzHKdR3/VtJ5ZTpACv7rDzpNHLN7chunwDorI6Ro7a1PGSxtD5KWhK23AMyEgusmEgj7VTlSIETlWMsA==',key_name='tempest-keypair-1619526100',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc2558af74dc4c419b153219d7149dd7',ramdisk_id='',reservation_id='r-6im7okhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1481713468',owner_user_name='tempest-ServerStableDeviceRescueTest-1481713468-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b24840d59e14692a62430236835c592',uuid=d7bc97ea-3b81-488c-8c63-b83a351118d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "vif_mac": "fa:16:3e:b1:69:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Converting VIF {"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "vif_mac": "fa:16:3e:b1:69:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:69:e0,bridge_name='br-int',has_traffic_filtering=True,id=cea7b68d-7124-4c01-94b1-73632f0c4000,network=Network(87a2a009-9d19-43e6-aa94-a6dd1d7f5764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7b68d-71') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'pci_devices' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:13:57 user nova-compute[74681]:   <uuid>d7bc97ea-3b81-488c-8c63-b83a351118d2</uuid>
Aug 16 06:13:57 user nova-compute[74681]:   <name>instance-00000004</name>
Aug 16 06:13:57 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:13:57 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:13:57 user nova-compute[74681]:   <metadata>
Aug 16 06:13:57 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:13:57 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:13:57 user nova-compute[74681]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1131256241</nova:name>
Aug 16 06:13:57 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:13:57</nova:creationTime>
Aug 16 06:13:57 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:13:57 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:13:57 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:13:57 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:13:57 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:13:57 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:13:57 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:13:57 user nova-compute[74681]:       <nova:owner>
Aug 16 06:13:57 user nova-compute[74681]:         <nova:user uuid="4b24840d59e14692a62430236835c592">tempest-ServerStableDeviceRescueTest-1481713468-project-member</nova:user>
Aug 16 06:13:57 user nova-compute[74681]:         <nova:project uuid="dc2558af74dc4c419b153219d7149dd7">tempest-ServerStableDeviceRescueTest-1481713468</nova:project>
Aug 16 06:13:57 user nova-compute[74681]:       </nova:owner>
Aug 16 06:13:57 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:13:57 user nova-compute[74681]:       <nova:ports>
Aug 16 06:13:57 user nova-compute[74681]:         <nova:port uuid="cea7b68d-7124-4c01-94b1-73632f0c4000">
Aug 16 06:13:57 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 06:13:57 user nova-compute[74681]:         </nova:port>
Aug 16 06:13:57 user nova-compute[74681]:       </nova:ports>
Aug 16 06:13:57 user nova-compute[74681]:     </nova:instance>
Aug 16 06:13:57 user nova-compute[74681]:   </metadata>
Aug 16 06:13:57 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:13:57 user nova-compute[74681]:     <system>
Aug 16 06:13:57 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:13:57 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:13:57 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:13:57 user nova-compute[74681]:       <entry name="serial">d7bc97ea-3b81-488c-8c63-b83a351118d2</entry>
Aug 16 06:13:57 user nova-compute[74681]:       <entry name="uuid">d7bc97ea-3b81-488c-8c63-b83a351118d2</entry>
Aug 16 06:13:57 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:13:57 user nova-compute[74681]:     </system>
Aug 16 06:13:57 user nova-compute[74681]:   </sysinfo>
Aug 16 06:13:57 user nova-compute[74681]:   <os>
Aug 16 06:13:57 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:13:57 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:13:57 user nova-compute[74681]:   </os>
Aug 16 06:13:57 user nova-compute[74681]:   <features>
Aug 16 06:13:57 user nova-compute[74681]:     <acpi/>
Aug 16 06:13:57 user nova-compute[74681]:     <apic/>
Aug 16 06:13:57 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:13:57 user nova-compute[74681]:   </features>
Aug 16 06:13:57 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:13:57 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:13:57 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:13:57 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:13:57 user nova-compute[74681]:   </clock>
Aug 16 06:13:57 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:13:57 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:13:57 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:13:57 user nova-compute[74681]:   </cpu>
Aug 16 06:13:57 user nova-compute[74681]:   <devices>
Aug 16 06:13:57 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:13:57 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:13:57 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk"/>
Aug 16 06:13:57 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:13:57 user nova-compute[74681]:     </disk>
Aug 16 06:13:57 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:13:57 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:13:57 user nova-compute[74681]:       <source dev="/dev/sdf"/>
Aug 16 06:13:57 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:13:57 user nova-compute[74681]:       <serial>fa0fc499-46b6-44aa-aa5a-76069df747f8</serial>
Aug 16 06:13:57 user nova-compute[74681]:     </disk>
Aug 16 06:13:57 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:13:57 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:13:57 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue"/>
Aug 16 06:13:57 user nova-compute[74681]:       <target dev="vdc" bus="virtio"/>
Aug 16 06:13:57 user nova-compute[74681]:       <boot order="1"/>
Aug 16 06:13:57 user nova-compute[74681]:     </disk>
Aug 16 06:13:57 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:13:57 user nova-compute[74681]:       <mac address="fa:16:3e:b1:69:e0"/>
Aug 16 06:13:57 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:13:57 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:13:57 user nova-compute[74681]:       <target dev="tapcea7b68d-71"/>
Aug 16 06:13:57 user nova-compute[74681]:     </interface>
Aug 16 06:13:57 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:13:57 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/console.log" append="off"/>
Aug 16 06:13:57 user nova-compute[74681]:     </serial>
Aug 16 06:13:57 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:13:57 user nova-compute[74681]:     <video>
Aug 16 06:13:57 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:13:57 user nova-compute[74681]:     </video>
Aug 16 06:13:57 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:13:57 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:13:57 user nova-compute[74681]:     </rng>
Aug 16 06:13:57 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:13:57 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:13:57 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:13:57 user nova-compute[74681]:     </memballoon>
Aug 16 06:13:57 user nova-compute[74681]:   </devices>
Aug 16 06:13:57 user nova-compute[74681]: </domain>
Aug 16 06:13:57 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquired lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:13:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance destroyed successfully.
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:13:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] No VIF found with MAC fa:16:3e:b1:69:e0, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating instance_info_cache with network_info: [{"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Releasing lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Starting migrate_disk_and_power_off {{(pid=74681) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-b6fe675b-0c2b-442e-b2be-b61dfb34ae63 req-935acba3-e9bb-4cc3-87be-d01062c1e51b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received event network-vif-unplugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b6fe675b-0c2b-442e-b2be-b61dfb34ae63 req-935acba3-e9bb-4cc3-87be-d01062c1e51b service nova] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b6fe675b-0c2b-442e-b2be-b61dfb34ae63 req-935acba3-e9bb-4cc3-87be-d01062c1e51b service nova] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b6fe675b-0c2b-442e-b2be-b61dfb34ae63 req-935acba3-e9bb-4cc3-87be-d01062c1e51b service nova] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:13:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-b6fe675b-0c2b-442e-b2be-b61dfb34ae63 req-935acba3-e9bb-4cc3-87be-d01062c1e51b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] No waiting events found dispatching network-vif-unplugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:13:58 user nova-compute[74681]: WARNING nova.compute.manager [req-b6fe675b-0c2b-442e-b2be-b61dfb34ae63 req-935acba3-e9bb-4cc3-87be-d01062c1e51b service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received unexpected event network-vif-unplugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c for instance with vm_state active and task_state resize_migrating.
Aug 16 06:13:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance destroyed successfully.
Aug 16 06:13:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-531426131',display_name='tempest-ServerActionsTestOtherB-server-531426131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-531426131',id=3,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWlIoTicQCRzN4ho+jH6G0ba9amolIyK2LT+pFMzFui3SxetiZZayKLGlFWxVg76CqjpfkgyxdZS4PxM2hlDKSKmqhhIQRwcBAryoq1HKw9nWQttQnXQLtyPZgNVZBs/A==',key_name='tempest-keypair-1862071311',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b3563d8bdb54a0aa3862684760dbe3e',ramdisk_id='',reservation_id='r-i4lgm6v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1555615278',owner_user_name='tempest-ServerActionsTestOtherB-1555615278-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:13:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2e5fe13505244ef92353a7ba756551c',uuid=70390b89-fdfb-4552-98e5-35568c0268bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-928987624-network", "vif_mac": "fa:16:3e:95:96:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Converting VIF {"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-928987624-network", "vif_mac": "fa:16:3e:95:96:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_vif [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd431340f-a0, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: INFO os_vif [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0')
Aug 16 06:13:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVgzeHyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:13:59 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d973532-5208-49e2-aeb1-2b3970f56dbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d64020-1110-4e62-8796-1d8c1b685f4d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:13:59 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:13:59 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948427c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f'): ({'sdj'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Removing single pathed devices sdj {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d7cd90-ff65-4368-b46d-645fe1b13184]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ab72bc-19e3-4107-ad0b-7425bc535568]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Flushing IO for device /dev/sdj {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadf8e09-c56d-4614-ad34-95f5392d85d9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.059s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5de7dd-e032-4623-929b-212e652a9af6]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] SCSI volumes sdj have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fd3f7d-583a-40e3-814e-ad1c7a5c7ad0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --logout" returned: 0 in 0.208s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0bb285-ce55-4685-a9b6-44ea517313a9]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f, portal: 172.16.0.220,3260]
Aug 16 06:13:59 user nova-compute[74681]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f, portal: 172.16.0.220,3260] successful.
Aug 16 06:13:59 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4d7a17-8781-4051-aec7-16ca988191cf]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.510s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] <== disconnect_volume: return (511ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:13:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-cc221f52-31e1-4dc7-9c3c-6bafbaca9d9f req-c336f43a-2863-4027-80e2-73781ba7bd51 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cc221f52-31e1-4dc7-9c3c-6bafbaca9d9f req-c336f43a-2863-4027-80e2-73781ba7bd51 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cc221f52-31e1-4dc7-9c3c-6bafbaca9d9f req-c336f43a-2863-4027-80e2-73781ba7bd51 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cc221f52-31e1-4dc7-9c3c-6bafbaca9d9f req-c336f43a-2863-4027-80e2-73781ba7bd51 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-cc221f52-31e1-4dc7-9c3c-6bafbaca9d9f req-c336f43a-2863-4027-80e2-73781ba7bd51 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:00 user nova-compute[74681]: WARNING nova.compute.manager [req-cc221f52-31e1-4dc7-9c3c-6bafbaca9d9f req-c336f43a-2863-4027-80e2-73781ba7bd51 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state active and task_state rescuing.
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.objects.instance [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'pci_requests' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.objects.instance [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'numa_topology' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:14:00 user nova-compute[74681]: INFO nova.compute.claims [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Claim successful on node user
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize/disk /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-c1526334-1a9a-4258-a0e5-eec1ecd6ca2f req-5bd6b25d-6417-4958-9973-e84842e3f099 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received event network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1526334-1a9a-4258-a0e5-eec1ecd6ca2f req-5bd6b25d-6417-4958-9973-e84842e3f099 service nova] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1526334-1a9a-4258-a0e5-eec1ecd6ca2f req-5bd6b25d-6417-4958-9973-e84842e3f099 service nova] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1526334-1a9a-4258-a0e5-eec1ecd6ca2f req-5bd6b25d-6417-4958-9973-e84842e3f099 service nova] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-c1526334-1a9a-4258-a0e5-eec1ecd6ca2f req-5bd6b25d-6417-4958-9973-e84842e3f099 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] No waiting events found dispatching network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:00 user nova-compute[74681]: WARNING nova.compute.manager [req-c1526334-1a9a-4258-a0e5-eec1ecd6ca2f req-5bd6b25d-6417-4958-9973-e84842e3f099 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received unexpected event network-vif-plugged-d431340f-a0ca-42db-aa2d-0a1a0e885c9c for instance with vm_state active and task_state resize_migrating.
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "cp -r /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize/disk /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk" returned: 0 in 0.469s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize/disk.info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk.info {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] CMD "cp -r /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize/disk.info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk.info" returned: 0 in 0.051s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:01 user nova-compute[74681]: INFO nova.network.neutron [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-6fbeb686-9379-487d-a796-7f23d8247cf8 req-05eebf3f-2ccc-43a6-87ce-aa1d976579b2 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-changed-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-6fbeb686-9379-487d-a796-7f23d8247cf8 req-05eebf3f-2ccc-43a6-87ce-aa1d976579b2 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing instance network info cache due to event network-changed-b5f52a79-949a-4249-afc8-049040df17a1. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fbeb686-9379-487d-a796-7f23d8247cf8 req-05eebf3f-2ccc-43a6-87ce-aa1d976579b2 service nova] Acquiring lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fbeb686-9379-487d-a796-7f23d8247cf8 req-05eebf3f-2ccc-43a6-87ce-aa1d976579b2 service nova] Acquired lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG nova.network.neutron [req-6fbeb686-9379-487d-a796-7f23d8247cf8 req-05eebf3f-2ccc-43a6-87ce-aa1d976579b2 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Refreshing network info cache for port b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fb44abc4-a407-4583-ad40-68f247f068d2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for d7bc97ea-3b81-488c-8c63-b83a351118d2 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:14:01 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166441.9890432, d7bc97ea-3b81-488c-8c63-b83a351118d2 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] VM Resumed (Lifecycle Event)
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:14:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166441.9936454, d7bc97ea-3b81-488c-8c63-b83a351118d2 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] VM Started (Lifecycle Event)
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-d6a1c74c-774d-45d4-8034-52aea013179a req-1e389e21-7caa-4a4f-b176-ef9ce32c93aa service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d6a1c74c-774d-45d4-8034-52aea013179a req-1e389e21-7caa-4a4f-b176-ef9ce32c93aa service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d6a1c74c-774d-45d4-8034-52aea013179a req-1e389e21-7caa-4a4f-b176-ef9ce32c93aa service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d6a1c74c-774d-45d4-8034-52aea013179a req-1e389e21-7caa-4a4f-b176-ef9ce32c93aa service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-d6a1c74c-774d-45d4-8034-52aea013179a req-1e389e21-7caa-4a4f-b176-ef9ce32c93aa service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:02 user nova-compute[74681]: WARNING nova.compute.manager [req-d6a1c74c-774d-45d4-8034-52aea013179a req-1e389e21-7caa-4a4f-b176-ef9ce32c93aa service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state rescued and task_state None.
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.network.neutron [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Port d431340f-a0ca-42db-aa2d-0a1a0e885c9c binding to destination host user is already ACTIVE {{(pid=74681) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.network.neutron [req-6fbeb686-9379-487d-a796-7f23d8247cf8 req-05eebf3f-2ccc-43a6-87ce-aa1d976579b2 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updated VIF entry in instance network info cache for port b5f52a79-949a-4249-afc8-049040df17a1. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.network.neutron [req-6fbeb686-9379-487d-a796-7f23d8247cf8 req-05eebf3f-2ccc-43a6-87ce-aa1d976579b2 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [{"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fbeb686-9379-487d-a796-7f23d8247cf8 req-05eebf3f-2ccc-43a6-87ce-aa1d976579b2 service nova] Releasing lock "refresh_cache-ff2064c1-e1bb-4abe-ab33-ced79efbeadc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquired lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.network.neutron [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquired lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:02 user nova-compute[74681]: DEBUG nova.network.neutron [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-20964597-7de2-437b-a250-ee34c1863e11 req-a787b84f-295e-4c83-b774-55f2ca2b625a service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-changed-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-20964597-7de2-437b-a250-ee34c1863e11 req-a787b84f-295e-4c83-b774-55f2ca2b625a service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Refreshing instance network info cache due to event network-changed-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-20964597-7de2-437b-a250-ee34c1863e11 req-a787b84f-295e-4c83-b774-55f2ca2b625a service nova] Acquiring lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG nova.network.neutron [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Releasing lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:14:03 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Creating image(s)
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG nova.objects.instance [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG nova.network.neutron [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating instance_info_cache with network_info: [{"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-20964597-7de2-437b-a250-ee34c1863e11 req-a787b84f-295e-4c83-b774-55f2ca2b625a service nova] Acquired lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG nova.network.neutron [req-20964597-7de2-437b-a250-ee34c1863e11 req-a787b84f-295e-4c83-b774-55f2ca2b625a service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Refreshing network info cache for port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "8ba7cecd8da43362db30a9838625acf8c6248211" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "8ba7cecd8da43362db30a9838625acf8c6248211" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Releasing lock "refresh_cache-70390b89-fdfb-4552-98e5-35568c0268bc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG os_brick.utils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ace2e-e8a8-45f0-bce2-e0b6da026663]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:04 user nova-compute[74681]: INFO nova.compute.manager [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Terminating instance
Aug 16 06:14:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe6efc4-ef26-4ace-922b-57ce889d9c61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:04 user nova-compute[74681]: INFO nova.compute.manager [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Terminating instance
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfad5a21-0d60-4bfb-ba03-a30b5c50acf2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46285e7-10cc-43b7-870b-22f3fec07e63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211.part --force-share --output=json" returned: 0 in 0.227s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG nova.virt.images [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] e6caf706-da80-464d-a284-61897af5e7e6 was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211.part /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:14:04 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:14:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c009c5d-4e97-4077-9ce4-3f59771f4d4a]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG os_brick.utils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211.part /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211.converted" returned: 0 in 0.459s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-ae58da0d-4ed7-4581-a508-88bdee997b28 req-3f128412-efea-4754-9381-63f1060ef067 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ae58da0d-4ed7-4581-a508-88bdee997b28 req-3f128412-efea-4754-9381-63f1060ef067 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ae58da0d-4ed7-4581-a508-88bdee997b28 req-3f128412-efea-4754-9381-63f1060ef067 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ae58da0d-4ed7-4581-a508-88bdee997b28 req-3f128412-efea-4754-9381-63f1060ef067 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-ae58da0d-4ed7-4581-a508-88bdee997b28 req-3f128412-efea-4754-9381-63f1060ef067 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-unplugged-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-ae58da0d-4ed7-4581-a508-88bdee997b28 req-3f128412-efea-4754-9381-63f1060ef067 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-b5f52a79-949a-4249-afc8-049040df17a1 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "8ba7cecd8da43362db30a9838625acf8c6248211" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.892s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-09b752b5-9120-4493-a7d6-cee08f6bd778 req-992654cb-330e-499e-8e01-0d097d27132c service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-09b752b5-9120-4493-a7d6-cee08f6bd778 req-992654cb-330e-499e-8e01-0d097d27132c service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-09b752b5-9120-4493-a7d6-cee08f6bd778 req-992654cb-330e-499e-8e01-0d097d27132c service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-09b752b5-9120-4493-a7d6-cee08f6bd778 req-992654cb-330e-499e-8e01-0d097d27132c service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-09b752b5-9120-4493-a7d6-cee08f6bd778 req-992654cb-330e-499e-8e01-0d097d27132c service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-unplugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-09b752b5-9120-4493-a7d6-cee08f6bd778 req-992654cb-330e-499e-8e01-0d097d27132c service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-3169a29b-abac-4134-8fe5-d5b66fe4a8fb req-4ec0daeb-503f-4667-b94c-fe891d6a0f72 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received event network-vif-unplugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3169a29b-abac-4134-8fe5-d5b66fe4a8fb req-4ec0daeb-503f-4667-b94c-fe891d6a0f72 service nova] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3169a29b-abac-4134-8fe5-d5b66fe4a8fb req-4ec0daeb-503f-4667-b94c-fe891d6a0f72 service nova] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3169a29b-abac-4134-8fe5-d5b66fe4a8fb req-4ec0daeb-503f-4667-b94c-fe891d6a0f72 service nova] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-3169a29b-abac-4134-8fe5-d5b66fe4a8fb req-4ec0daeb-503f-4667-b94c-fe891d6a0f72 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] No waiting events found dispatching network-vif-unplugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-3169a29b-abac-4134-8fe5-d5b66fe4a8fb req-4ec0daeb-503f-4667-b94c-fe891d6a0f72 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received event network-vif-unplugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:05 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Instance destroyed successfully.
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.objects.instance [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lazy-loading 'resources' on Instance uuid 9791d36b-9111-47c7-aa6d-c86645e1a453 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-699772952',display_name='tempest-TestVolumeSwap-server-699772952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-699772952',id=9,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtun0L5+WgKKfY2o/1FsHinbOK323MiKO2O3tuPPb15tXxR/k5AXt004TqPJMlRN92V/Ahmr/VS8Unks27JD3UXTYzRE42yMXT91/LK7jDTnIqwtqx9sH+7OBd9H2f6FA==',key_name='tempest-keypair-2106385838',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a54d0ad3b1e45a6acc243906b2483c0',ramdisk_id='',reservation_id='r-sihmshrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-441156882',owner_user_name='tempest-TestVolumeSwap-441156882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0ca9b1734834832b7eebf4fd4219a61',uuid=9791d36b-9111-47c7-aa6d-c86645e1a453,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Converting VIF {"id": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "address": "fa:16:3e:92:c7:9a", "network": {"id": "99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1112020497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a54d0ad3b1e45a6acc243906b2483c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a21da6-a5", "ovs_interfaceid": "f1a21da6-a59f-430a-8b0b-2d0ed16ac211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:c7:9a,bridge_name='br-int',has_traffic_filtering=True,id=f1a21da6-a59f-430a-8b0b-2d0ed16ac211,network=Network(99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a21da6-a5') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG os_vif [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:c7:9a,bridge_name='br-int',has_traffic_filtering=True,id=f1a21da6-a59f-430a-8b0b-2d0ed16ac211,network=Network(99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a21da6-a5') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1a21da6-a5, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211 --force-share --output=json" returned: 0 in 0.252s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "8ba7cecd8da43362db30a9838625acf8c6248211" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "8ba7cecd8da43362db30a9838625acf8c6248211" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.network.neutron [req-20964597-7de2-437b-a250-ee34c1863e11 req-a787b84f-295e-4c83-b774-55f2ca2b625a service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updated VIF entry in instance network info cache for port ca0bdeea-d3c9-4993-b9ee-a51a9dd66482. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG nova.network.neutron [req-20964597-7de2-437b-a250-ee34c1863e11 req-a787b84f-295e-4c83-b774-55f2ca2b625a service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-20964597-7de2-437b-a250-ee34c1863e11 req-a787b84f-295e-4c83-b774-55f2ca2b625a service nova] Releasing lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:06 user nova-compute[74681]: INFO os_vif [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:c7:9a,bridge_name='br-int',has_traffic_filtering=True,id=f1a21da6-a59f-430a-8b0b-2d0ed16ac211,network=Network(99ff0802-d4f6-4d14-bf7c-40c5ea4dbcd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a21da6-a5')
Aug 16 06:14:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Deleting instance files /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453_del
Aug 16 06:14:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Deletion of /opt/stack/data/nova/instances/9791d36b-9111-47c7-aa6d-c86645e1a453_del complete
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211 --force-share --output=json" returned: 0 in 0.219s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211,backing_fmt=raw /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:06 user nova-compute[74681]: INFO nova.compute.manager [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211,backing_fmt=raw /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk 1073741824" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "8ba7cecd8da43362db30a9838625acf8c6248211" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.419s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211 --force-share --output=json" returned: 0 in 0.226s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG nova.objects.instance [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'migration_context' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Rebasing disk image.
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.274s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe -F raw /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Instance destroyed successfully.
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.objects.instance [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lazy-loading 'resources' on Instance uuid ff2064c1-e1bb-4abe-ab33-ced79efbeadc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:71:60,bridge_name='br-int',has_traffic_filtering=True,id=b5f52a79-949a-4249-afc8-049040df17a1,network=Network(ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f52a79-94') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:71:60,bridge_name='br-int',has_traffic_filtering=True,id=b5f52a79-949a-4249-afc8-049040df17a1,network=Network(ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f52a79-94') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f52a79-94, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: INFO os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:71:60,bridge_name='br-int',has_traffic_filtering=True,id=b5f52a79-949a-4249-afc8-049040df17a1,network=Network(ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f52a79-94')
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:68:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb1026fe-e425-441b-ad89-37e2d6e125de,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb1026fe-e4') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:68:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb1026fe-e425-441b-ad89-37e2d6e125de,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb1026fe-e4') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb1026fe-e4, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: INFO os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:68:dd,bridge_name='br-int',has_traffic_filtering=True,id=bb1026fe-e425-441b-ad89-37e2d6e125de,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb1026fe-e4')
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=c6d84664-b42d-4b02-a71a-17c3471e5bf3,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6d84664-b4') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=c6d84664-b42d-4b02-a71a-17c3471e5bf3,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6d84664-b4') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6d84664-b4, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: INFO os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b7:23,bridge_name='br-int',has_traffic_filtering=True,id=c6d84664-b42d-4b02-a71a-17c3471e5bf3,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc6d84664-b4')
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:94,bridge_name='br-int',has_traffic_filtering=True,id=e9336b44-5798-4ac0-ae76-404bc96738a9,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9336b44-57') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:94,bridge_name='br-int',has_traffic_filtering=True,id=e9336b44-5798-4ac0-ae76-404bc96738a9,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9336b44-57') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9336b44-57, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: INFO os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e2:94,bridge_name='br-int',has_traffic_filtering=True,id=e9336b44-5798-4ac0-ae76-404bc96738a9,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9336b44-57')
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:9c,bridge_name='br-int',has_traffic_filtering=True,id=59f6c45b-5dbf-43f3-936f-fd4280d13103,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6c45b-5d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:9c,bridge_name='br-int',has_traffic_filtering=True,id=59f6c45b-5dbf-43f3-936f-fd4280d13103,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6c45b-5d') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59f6c45b-5d, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-09b61d79-192d-4ae6-b1ea-69cbc516c0f4 req-30ec5d96-de10-427f-a917-5392f53417c1 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-09b61d79-192d-4ae6-b1ea-69cbc516c0f4 req-30ec5d96-de10-427f-a917-5392f53417c1 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-09b61d79-192d-4ae6-b1ea-69cbc516c0f4 req-30ec5d96-de10-427f-a917-5392f53417c1 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-09b61d79-192d-4ae6-b1ea-69cbc516c0f4 req-30ec5d96-de10-427f-a917-5392f53417c1 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-09b61d79-192d-4ae6-b1ea-69cbc516c0f4 req-30ec5d96-de10-427f-a917-5392f53417c1 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: WARNING nova.compute.manager [req-09b61d79-192d-4ae6-b1ea-69cbc516c0f4 req-30ec5d96-de10-427f-a917-5392f53417c1 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-b5f52a79-949a-4249-afc8-049040df17a1 for instance with vm_state active and task_state deleting.
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: INFO os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:13:9c,bridge_name='br-int',has_traffic_filtering=True,id=59f6c45b-5dbf-43f3-936f-fd4280d13103,network=Network(2b4edc37-5118-4db8-acd4-aa3c7957bee7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f6c45b-5d')
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:7b:ba,bridge_name='br-int',has_traffic_filtering=True,id=30bbb3b0-cdf3-46b3-b418-e908e295b5b2,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bbb3b0-cd') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7b:ba,bridge_name='br-int',has_traffic_filtering=True,id=30bbb3b0-cdf3-46b3-b418-e908e295b5b2,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bbb3b0-cd') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30bbb3b0-cd, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: INFO os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:7b:ba,bridge_name='br-int',has_traffic_filtering=True,id=30bbb3b0-cdf3-46b3-b418-e908e295b5b2,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30bbb3b0-cd')
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1296303401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1296303401',id=11,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKahvFbg3kry5X29rDWjJZrO5WVyD/KEqcQgr2UNTmCHz9Xob6GE5eA4RzEoyoUoclzGaQ1aGueA5Js1yLbaiDxltRJo/LtDfqFPfpfSMjhaROlF26WAvL1Lk+N0OaOg9w==',key_name='tempest-keypair-733586875',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='723ad3bf69ae47cd9c3b28f8b4174568',ramdisk_id='',reservation_id='r-58r1509q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1486639203',owner_user_name='tempest-TaggedBootDevicesTest-1486639203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='842f744ea91e4c12bc1bf04f725c5ed1',uuid=ff2064c1-e1bb-4abe-ab33-ced79efbeadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converting VIF {"id": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "address": "fa:16:3e:2a:0b:4e", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1128321-8d", "ovs_interfaceid": "c1128321-8d72-4bd5-a749-65b9b6adb4ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:0b:4e,bridge_name='br-int',has_traffic_filtering=True,id=c1128321-8d72-4bd5-a749-65b9b6adb4ee,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1128321-8d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:0b:4e,bridge_name='br-int',has_traffic_filtering=True,id=c1128321-8d72-4bd5-a749-65b9b6adb4ee,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1128321-8d') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1128321-8d, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:07 user nova-compute[74681]: INFO os_vif [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:0b:4e,bridge_name='br-int',has_traffic_filtering=True,id=c1128321-8d72-4bd5-a749-65b9b6adb4ee,network=Network(acd511e3-6c9f-472c-89ea-8361a25c26bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1128321-8d')
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VdgsKyEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:07 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02737a8-59b2-4981-8825-db3e2ddae279]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bd4349-8137-45c2-8184-14eb2e585882]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:07 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94842af010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[733238f7-3d5a-4d2f-a355-31bc336739f8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd88bb21-80fb-464b-84b0-6bca7e60d380]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edc593b-c052-48f6-9136-35ee57b405a4]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: WARNING nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-c6d84664-b42d-4b02-a71a-17c3471e5bf3 for instance with vm_state active and task_state deleting.
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-unplugged-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-e9336b44-5798-4ac0-ae76-404bc96738a9 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: WARNING nova.compute.manager [req-8655b668-f4e1-4015-9f1d-6696a621ae2b req-9968b559-0295-4ad6-8f59-3fc08d5529d0 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-e9336b44-5798-4ac0-ae76-404bc96738a9 for instance with vm_state active and task_state deleting.
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba2ebf6-b517-4be9-b311-f3165fa824a7]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[967af622-bfd3-45f1-b27b-b2b2d0a5c7df]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received event network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Acquiring lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] No waiting events found dispatching network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: WARNING nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received unexpected event network-vif-plugged-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 for instance with vm_state active and task_state deleting.
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-unplugged-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-bb1026fe-e425-441b-ad89-37e2d6e125de for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: WARNING nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-bb1026fe-e425-441b-ad89-37e2d6e125de for instance with vm_state active and task_state deleting.
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-unplugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:07 user nova-compute[74681]: WARNING nova.compute.manager [req-4fca80e3-38a6-4e9c-bdf3-ef54735f7d3b req-a7a61a7c-c8fa-4367-b2a9-e20697fb5a84 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-59f6c45b-5dbf-43f3-936f-fd4280d13103 for instance with vm_state active and task_state deleting.
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd973a60-3f24-4046-8b70-ba98295064f9]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7, portal: 172.16.0.220,3260]
Aug 16 06:14:07 user nova-compute[74681]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7, portal: 172.16.0.220,3260] successful.
Aug 16 06:14:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.062s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c300099-4f19-4be0-a75d-e8f71577c2a0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== disconnect_volume: return (428ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRjSvcap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:07 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f542ad4-d008-445b-b6b1-e96f7fe6cee8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ea774-e0bb-4017-9a7d-d3900550fb3a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94a1dddb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9841b8-021a-48fc-a16c-540ddae58be0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b15cf7-39ac-4af4-b97e-6c464dbbc504]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ac50fa-03eb-4fca-95ab-e154f004ba2c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaacc30-7778-4d0f-89c5-89e0fea11184]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf8568f-6bcc-47fe-9692-5f4800b1e301]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67afebd-4e64-4242-809f-79b2b0b9a5e9]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767, portal: 172.16.0.220,3260]
Aug 16 06:14:08 user nova-compute[74681]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767, portal: 172.16.0.220,3260] successful.
Aug 16 06:14:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5047d252-a8d1-497c-b7f9-4e53b36ba767 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df27e3-709d-424e-8f99-9dc877cae645]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== disconnect_volume: return (393ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxYgOefU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:08 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b035cb-f200-484a-936d-df96272035ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[19629c2b-174c-4ae8-badc-aaea37656f91]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:08 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94a1dddb40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035'): ({'sde'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Removing single pathed devices sde {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81c6dac-ddcf-43f1-82ba-88e0e5d58f7b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f9dba9-a0b4-44c7-bc50-af6c8c6ccbda]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Flushing IO for device /dev/sde {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a348286a-5862-46fe-80c4-b21fe9e1eb08]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.148s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df8c2cd-ea6b-4668-b752-b7d3d0cec80f]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.076s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023f54a-a015-4005-8dc2-220a853f71f9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:08 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Took 2.59 seconds to deallocate network for instance.
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[39118154-f0be-467c-9dba-98f09d5a87f0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035, portal: 172.16.0.220,3260]
Aug 16 06:14:08 user nova-compute[74681]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035, portal: 172.16.0.220,3260] successful.
Aug 16 06:14:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a9921b-dc75-4c9f-a3e4-a428f60d7035 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[154da8d1-1052-40b4-86c7-6fe6504cde8b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.583s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] <== disconnect_volume: return (584ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:14:08 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Deleting instance files /opt/stack/data/nova/instances/ff2064c1-e1bb-4abe-ab33-ced79efbeadc_del
Aug 16 06:14:08 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Deletion of /opt/stack/data/nova/instances/ff2064c1-e1bb-4abe-ab33-ced79efbeadc_del complete
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:09 user nova-compute[74681]: INFO nova.compute.manager [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Took 4.30 seconds to destroy the instance on the hypervisor.
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166434.2590752, c3c07afb-5fb6-456d-a631-028e7c817b23 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:09 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] VM Stopped (Lifecycle Event)
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8be5e5b6-3433-4f08-8b7c-832e6269434b None None] [instance: c3c07afb-5fb6-456d-a631-028e7c817b23] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:09 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Deleted allocations for instance 9791d36b-9111-47c7-aa6d-c86645e1a453
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e01494-8c16-41eb-9052-ff21ac017616 tempest-TestVolumeSwap-441156882 tempest-TestVolumeSwap-441156882-project-member] Lock "9791d36b-9111-47c7-aa6d-c86645e1a453" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.996s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe -F raw /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk" returned: 0 in 3.034s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Ensure instance console log exists: /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Start _get_guest_xml network_info=[{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='42d33d33066409f8306f3e8420367df3',container_format='bare',created_at=2023-08-16T06:11:56Z,direct_url=<?>,disk_format='qcow2',id=e6caf706-da80-464d-a284-61897af5e7e6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1357676255-shelved',owner='f7ed7ef3df024e178e16f79008239e48',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T06:12:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': 'dcd15f36-e061-4ccd-8c5e-9872ffad63dd', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvrUayuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '90188af1-901c-453f-b113-133b1e86bc85', 'attached_at': '', 'detached_at': '', 'volume_id': '1842ce72-883c-462a-be3c-2823df2e854b', 'serial': '1842ce72-883c-462a-be3c-2823df2e854b'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-99735aa9-c84f-401c-9ac5-93cd1e892472 req-4d29a71d-ad63-4944-abcd-222e882abd64 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-changed-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-99735aa9-c84f-401c-9ac5-93cd1e892472 req-4d29a71d-ad63-4944-abcd-222e882abd64 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing instance network info cache due to event network-changed-2444d2a9-2e73-4b49-8a8c-431f68776ab9. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-99735aa9-c84f-401c-9ac5-93cd1e892472 req-4d29a71d-ad63-4944-abcd-222e882abd64 service nova] Acquiring lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-99735aa9-c84f-401c-9ac5-93cd1e892472 req-4d29a71d-ad63-4944-abcd-222e882abd64 service nova] Acquired lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-99735aa9-c84f-401c-9ac5-93cd1e892472 req-4d29a71d-ad63-4944-abcd-222e882abd64 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Refreshing network info cache for port 2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-unplugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Received event network-vif-deleted-f1a21da6-a59f-430a-8b0b-2d0ed16ac211 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:09 user nova-compute[74681]: WARNING nova.compute.manager [req-ef13faa0-84cc-4acd-8329-58a343aa7865 req-15a64ba3-3d68-4314-bc7f-caca29e1f7e8 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 for instance with vm_state active and task_state deleting.
Aug 16 06:14:09 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:14:09 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='42d33d33066409f8306f3e8420367df3',container_format='bare',created_at=2023-08-16T06:11:56Z,direct_url=<?>,disk_format='qcow2',id=e6caf706-da80-464d-a284-61897af5e7e6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1357676255-shelved',owner='f7ed7ef3df024e178e16f79008239e48',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T06:12:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:14:09 user nova-compute[74681]: DEBUG nova.objects.instance [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvrUayuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:10 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:10 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:10 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ef3f7-97aa-4125-865e-2735f456797f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:14:10 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da905d-3a15-4701-a7f3-76b3d92e5335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b] added
Aug 16 06:14:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f9737-f10f-437d-8db2-7379648f7958]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b5b1c4-5155-4b87-95e7-3bef7aedcc8d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvrUayuW {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvrUayuW" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f1feea-72a1-4876-a4f8-673d7af4900e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvrUayuW'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248920d-0851-460f-9458-56049f0a05a2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2601bfe-259d-4ddd-a15c-0cd880bdca42]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac104c5-d38b-4d72-800e-1b3b9218d264]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b, portal: 172.16.0.220,3260]
Aug 16 06:14:10 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b, portal: 172.16.0.220,3260] successful.
Aug 16 06:14:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c296089e-cc09-4cd5-9a44-3acce7a86df0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e7c736-d9fa-43b8-8d6a-ca4bc1471f0c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:10 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b060b0d-5c87-46d6-9a9c-613c632d9c1f]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvrUayuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:14:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.network.neutron [req-99735aa9-c84f-401c-9ac5-93cd1e892472 req-4d29a71d-ad63-4944-abcd-222e882abd64 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updated VIF entry in instance network info cache for port 2444d2a9-2e73-4b49-8a8c-431f68776ab9. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.network.neutron [req-99735aa9-c84f-401c-9ac5-93cd1e892472 req-4d29a71d-ad63-4944-abcd-222e882abd64 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [{"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-99735aa9-c84f-401c-9ac5-93cd1e892472 req-4d29a71d-ad63-4944-abcd-222e882abd64 service nova] Releasing lock "refresh_cache-3a31765d-c4f1-40f6-b63d-ed0830d4bed4" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26666623430643137', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666623430643137', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1357676255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1357676255',id=5,image_ref='e6caf706-da80-464d-a284-61897af5e7e6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1915031990',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-uaxulgsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member',shelved_at='2023-08-16T06:12:00.775085',shelved_host='user',shelved_image_id='e6caf706-da80-464d-a284-61897af5e7e6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=90188af1-901c-453f-b113-133b1e86bc85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.objects.instance [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'pci_devices' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:14:11 user nova-compute[74681]:   <uuid>90188af1-901c-453f-b113-133b1e86bc85</uuid>
Aug 16 06:14:11 user nova-compute[74681]:   <name>instance-00000005</name>
Aug 16 06:14:11 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:14:11 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:14:11 user nova-compute[74681]:   <metadata>
Aug 16 06:14:11 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:14:11 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:14:11 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1357676255</nova:name>
Aug 16 06:14:11 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:14:09</nova:creationTime>
Aug 16 06:14:11 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:14:11 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:14:11 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:14:11 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:14:11 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:14:11 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:14:11 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:14:11 user nova-compute[74681]:       <nova:owner>
Aug 16 06:14:11 user nova-compute[74681]:         <nova:user uuid="2e9ea2042eae46618172633ecf40bb62">tempest-AttachVolumeShelveTestJSON-1422435949-project-member</nova:user>
Aug 16 06:14:11 user nova-compute[74681]:         <nova:project uuid="f7ed7ef3df024e178e16f79008239e48">tempest-AttachVolumeShelveTestJSON-1422435949</nova:project>
Aug 16 06:14:11 user nova-compute[74681]:       </nova:owner>
Aug 16 06:14:11 user nova-compute[74681]:       <nova:root type="image" uuid="e6caf706-da80-464d-a284-61897af5e7e6"/>
Aug 16 06:14:11 user nova-compute[74681]:       <nova:ports>
Aug 16 06:14:11 user nova-compute[74681]:         <nova:port uuid="ca0bdeea-d3c9-4993-b9ee-a51a9dd66482">
Aug 16 06:14:11 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 06:14:11 user nova-compute[74681]:         </nova:port>
Aug 16 06:14:11 user nova-compute[74681]:       </nova:ports>
Aug 16 06:14:11 user nova-compute[74681]:     </nova:instance>
Aug 16 06:14:11 user nova-compute[74681]:   </metadata>
Aug 16 06:14:11 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:14:11 user nova-compute[74681]:     <system>
Aug 16 06:14:11 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:14:11 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:14:11 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:14:11 user nova-compute[74681]:       <entry name="serial">90188af1-901c-453f-b113-133b1e86bc85</entry>
Aug 16 06:14:11 user nova-compute[74681]:       <entry name="uuid">90188af1-901c-453f-b113-133b1e86bc85</entry>
Aug 16 06:14:11 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:14:11 user nova-compute[74681]:     </system>
Aug 16 06:14:11 user nova-compute[74681]:   </sysinfo>
Aug 16 06:14:11 user nova-compute[74681]:   <os>
Aug 16 06:14:11 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:14:11 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:14:11 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:14:11 user nova-compute[74681]:   </os>
Aug 16 06:14:11 user nova-compute[74681]:   <features>
Aug 16 06:14:11 user nova-compute[74681]:     <acpi/>
Aug 16 06:14:11 user nova-compute[74681]:     <apic/>
Aug 16 06:14:11 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:14:11 user nova-compute[74681]:   </features>
Aug 16 06:14:11 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:14:11 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:14:11 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:14:11 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:14:11 user nova-compute[74681]:   </clock>
Aug 16 06:14:11 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:14:11 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:14:11 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:14:11 user nova-compute[74681]:   </cpu>
Aug 16 06:14:11 user nova-compute[74681]:   <devices>
Aug 16 06:14:11 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:14:11 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:14:11 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk"/>
Aug 16 06:14:11 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:14:11 user nova-compute[74681]:     </disk>
Aug 16 06:14:11 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:14:11 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:14:11 user nova-compute[74681]:       <source dev="/dev/sdc"/>
Aug 16 06:14:11 user nova-compute[74681]:       <target dev="vdc" bus="virtio"/>
Aug 16 06:14:11 user nova-compute[74681]:       <serial>1842ce72-883c-462a-be3c-2823df2e854b</serial>
Aug 16 06:14:11 user nova-compute[74681]:     </disk>
Aug 16 06:14:11 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:14:11 user nova-compute[74681]:       <mac address="fa:16:3e:df:86:ff"/>
Aug 16 06:14:11 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:14:11 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:14:11 user nova-compute[74681]:       <target dev="tapca0bdeea-d3"/>
Aug 16 06:14:11 user nova-compute[74681]:     </interface>
Aug 16 06:14:11 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:14:11 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/console.log" append="off"/>
Aug 16 06:14:11 user nova-compute[74681]:     </serial>
Aug 16 06:14:11 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:14:11 user nova-compute[74681]:     <video>
Aug 16 06:14:11 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:14:11 user nova-compute[74681]:     </video>
Aug 16 06:14:11 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:14:11 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:14:11 user nova-compute[74681]:     </rng>
Aug 16 06:14:11 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:14:11 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:14:11 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:14:11 user nova-compute[74681]:     </memballoon>
Aug 16 06:14:11 user nova-compute[74681]:   </devices>
Aug 16 06:14:11 user nova-compute[74681]: </domain>
Aug 16 06:14:11 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1357676255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1357676255',id=5,image_ref='e6caf706-da80-464d-a284-61897af5e7e6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1915031990',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-uaxulgsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member',shelved_at='2023-08-16T06:12:00.775085',shelved_host='user',shelved_image_id='e6caf706-da80-464d-a284-61897af5e7e6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=90188af1-901c-453f-b113-133b1e86bc85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG os_vif [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca0bdeea-d3, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca0bdeea-d3, col_values=(('external_ids', {'iface-id': 'ca0bdeea-d3c9-4993-b9ee-a51a9dd66482', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:86:ff', 'vm-uuid': '90188af1-901c-453f-b113-133b1e86bc85'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:11 user nova-compute[74681]: INFO os_vif [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3')
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:14:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No VIF found with MAC fa:16:3e:df:86:ff, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-unplugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-unplugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] Acquiring lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] No waiting events found dispatching network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:12 user nova-compute[74681]: WARNING nova.compute.manager [req-06288548-52b5-417a-a519-862adda36e2d req-1093d869-d0f8-4c83-8c80-bc927921535d service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received unexpected event network-vif-plugged-c1128321-8d72-4bd5-a749-65b9b6adb4ee for instance with vm_state active and task_state deleting.
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:12 user nova-compute[74681]: INFO nova.compute.manager [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Terminating instance
Aug 16 06:14:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-2943b7d7-e4af-4e03-abaa-082a06bce913 req-0675e9ab-5741-450a-a14f-c8a50c613ed5 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2943b7d7-e4af-4e03-abaa-082a06bce913 req-0675e9ab-5741-450a-a14f-c8a50c613ed5 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2943b7d7-e4af-4e03-abaa-082a06bce913 req-0675e9ab-5741-450a-a14f-c8a50c613ed5 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2943b7d7-e4af-4e03-abaa-082a06bce913 req-0675e9ab-5741-450a-a14f-c8a50c613ed5 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-2943b7d7-e4af-4e03-abaa-082a06bce913 req-0675e9ab-5741-450a-a14f-c8a50c613ed5 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-unplugged-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-2943b7d7-e4af-4e03-abaa-082a06bce913 req-0675e9ab-5741-450a-a14f-c8a50c613ed5 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-14771914-909d-4cb0-a675-0a818671475d for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-130d4197-a644-4409-bda8-5290de82172d req-d1ab64fb-9b34-4672-b42d-e391bef14f66 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-130d4197-a644-4409-bda8-5290de82172d req-d1ab64fb-9b34-4672-b42d-e391bef14f66 service nova] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-130d4197-a644-4409-bda8-5290de82172d req-d1ab64fb-9b34-4672-b42d-e391bef14f66 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-130d4197-a644-4409-bda8-5290de82172d req-d1ab64fb-9b34-4672-b42d-e391bef14f66 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-130d4197-a644-4409-bda8-5290de82172d req-d1ab64fb-9b34-4672-b42d-e391bef14f66 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] No waiting events found dispatching network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:14 user nova-compute[74681]: WARNING nova.compute.manager [req-130d4197-a644-4409-bda8-5290de82172d req-d1ab64fb-9b34-4672-b42d-e391bef14f66 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received unexpected event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-deleted-c1128321-8d72-4bd5-a749-65b9b6adb4ee {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:14 user nova-compute[74681]: INFO nova.compute.manager [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Neutron deleted interface c1128321-8d72-4bd5-a749-65b9b6adb4ee; detaching it from the instance and deleting it from the info cache
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.network.neutron [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [{"id": "b5f52a79-949a-4249-afc8-049040df17a1", "address": "fa:16:3e:48:71:60", "network": {"id": "ff3db8cf-3af2-4b68-a3b9-75713bb2c3f1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1685694491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f52a79-94", "ovs_interfaceid": "b5f52a79-949a-4249-afc8-049040df17a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Detach interface failed, port_id=c1128321-8d72-4bd5-a749-65b9b6adb4ee, reason: Instance ff2064c1-e1bb-4abe-ab33-ced79efbeadc could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-unplugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-b84c584d-11dd-46fe-ab3e-0b541eebd585 req-8b8faa45-706e-4b04-ab0d-36d7815bf4b4 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166439.349611, 70390b89-fdfb-4552-98e5-35568c0268bc => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:14 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] VM Stopped (Lifecycle Event)
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d23b2696-4b26-4b43-afdd-161238763043 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d23b2696-4b26-4b43-afdd-161238763043 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:14:14 user nova-compute[74681]: INFO nova.compute.manager [None req-d23b2696-4b26-4b43-afdd-161238763043 None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 06:14:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Instance destroyed successfully.
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lazy-loading 'resources' on Instance uuid 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:79:94,bridge_name='br-int',has_traffic_filtering=True,id=2444d2a9-2e73-4b49-8a8c-431f68776ab9,network=Network(97119a6b-434e-442f-8757-a206b3c983c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2444d2a9-2e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:79:94,bridge_name='br-int',has_traffic_filtering=True,id=2444d2a9-2e73-4b49-8a8c-431f68776ab9,network=Network(97119a6b-434e-442f-8757-a206b3c983c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2444d2a9-2e') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2444d2a9-2e, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: INFO os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:79:94,bridge_name='br-int',has_traffic_filtering=True,id=2444d2a9-2e73-4b49-8a8c-431f68776ab9,network=Network(97119a6b-434e-442f-8757-a206b3c983c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2444d2a9-2e')
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:18,bridge_name='br-int',has_traffic_filtering=True,id=3bca746f-2df6-435e-85c2-f789ea8a5b8f,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bca746f-2d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:18,bridge_name='br-int',has_traffic_filtering=True,id=3bca746f-2df6-435e-85c2-f789ea8a5b8f,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bca746f-2d') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bca746f-2d, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: INFO os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:18,bridge_name='br-int',has_traffic_filtering=True,id=3bca746f-2df6-435e-85c2-f789ea8a5b8f,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bca746f-2d')
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=14771914-909d-4cb0-a675-0a818671475d,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14771914-90') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=14771914-909d-4cb0-a675-0a818671475d,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14771914-90') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14771914-90, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:15 user nova-compute[74681]: WARNING nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-14771914-909d-4cb0-a675-0a818671475d for instance with vm_state active and task_state deleting.
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-unplugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:15 user nova-compute[74681]: WARNING nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-9bb0411a-1cc3-491e-92a5-c5e54215a898 for instance with vm_state active and task_state deleting.
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-unplugged-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-368b421b-b98c-4fe9-919b-aa74db34f552 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:15 user nova-compute[74681]: WARNING nova.compute.manager [req-a88b1205-d014-4ee9-bd58-5d3306864417 req-e3e19cd1-83a4-4a5e-ac14-919b058ceff1 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-368b421b-b98c-4fe9-919b-aa74db34f552 for instance with vm_state active and task_state deleting.
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: INFO os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5f:03,bridge_name='br-int',has_traffic_filtering=True,id=14771914-909d-4cb0-a675-0a818671475d,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap14771914-90')
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:91:86,bridge_name='br-int',has_traffic_filtering=True,id=9bb0411a-1cc3-491e-92a5-c5e54215a898,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bb0411a-1c') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:91:86,bridge_name='br-int',has_traffic_filtering=True,id=9bb0411a-1cc3-491e-92a5-c5e54215a898,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bb0411a-1c') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bb0411a-1c, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: INFO os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:91:86,bridge_name='br-int',has_traffic_filtering=True,id=9bb0411a-1cc3-491e-92a5-c5e54215a898,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bb0411a-1c')
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "address": "fa:16:3e:b0:0e:e6", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6de23-b3", "ovs_interfaceid": "7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:e6,bridge_name='br-int',has_traffic_filtering=True,id=7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6de23-b3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:e6,bridge_name='br-int',has_traffic_filtering=True,id=7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6de23-b3') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fb6de23-b3, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: INFO os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0e:e6,bridge_name='br-int',has_traffic_filtering=True,id=7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4,network=Network(aee7f3c9-e7bc-4c9e-af56-05e882c59648),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6de23-b3')
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ee:9a,bridge_name='br-int',has_traffic_filtering=True,id=048cf7d9-d093-41eb-b546-a00c669a3dab,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap048cf7d9-d0') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ee:9a,bridge_name='br-int',has_traffic_filtering=True,id=048cf7d9-d093-41eb-b546-a00c669a3dab,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap048cf7d9-d0') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap048cf7d9-d0, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: INFO os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:ee:9a,bridge_name='br-int',has_traffic_filtering=True,id=048cf7d9-d093-41eb-b546-a00c669a3dab,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap048cf7d9-d0')
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T06:11:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1075213555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1075213555',id=12,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJxuzeZ6YiTAvjH1wsf5rmle1YVOTIr9+9PdpDd5/lWFdPSnfrwLY92Diqr6ZsgK1qgjwZyb1r3J/nCbI8w1Y8RxlB38iNdX3tDsixVq9UJ0FjVUS1g9B/Yn/u4QTHksw==',key_name='tempest-keypair-600532544',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83bf6983951747c287a2099077b61233',ramdisk_id='',reservation_id='r-zde3wc14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1526081836',owner_user_name='tempest-TaggedBootDevicesTest_v242-1526081836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df7ed94a0d504fb082655852eacc3f50',uuid=3a31765d-c4f1-40f6-b63d-ed0830d4bed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converting VIF {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:7f:66,bridge_name='br-int',has_traffic_filtering=True,id=368b421b-b98c-4fe9-919b-aa74db34f552,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b421b-b9') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7f:66,bridge_name='br-int',has_traffic_filtering=True,id=368b421b-b98c-4fe9-919b-aa74db34f552,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b421b-b9') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap368b421b-b9, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:15 user nova-compute[74681]: INFO os_vif [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:7f:66,bridge_name='br-int',has_traffic_filtering=True,id=368b421b-b98c-4fe9-919b-aa74db34f552,network=Network(f831dd64-23e0-4f38-8712-af2c107785b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368b421b-b9')
Aug 16 06:14:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pANQtHim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:15 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35e6bcb-90c9-4dca-bd96-57572fc035f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a6bdc-6a78-42f6-a080-6b22f2ede4d7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:15 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:15 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:15 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94841ea950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d'): ({'sdg'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Removing single pathed devices sdg {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e343f7-8566-4e30-8390-27c0217f740d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ae0467-da74-4184-8df6-c971ffd8afc2]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Flushing IO for device /dev/sdg {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aae9e1-ba35-4d50-915b-18611abdca1d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.067s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e520e0-ace6-48a4-a124-897d3ed11630]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] SCSI volumes sdg have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c76e56-00a0-4ece-91f6-5ccc838f62b5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[be59fcac-c739-4d8b-a406-a02f24a723a6]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d, portal: 172.16.0.220,3260]
Aug 16 06:14:15 user nova-compute[74681]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d, portal: 172.16.0.220,3260] successful.
Aug 16 06:14:15 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b86c91-e1b5-4e3f-8c24-12d92e6b899d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[432ecd0c-da44-467b-9f57-839960a887c7]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== disconnect_volume: return (405ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GubHvVrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:16 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[816199c0-a60d-4390-af90-dc53c6a3b651]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f74c71-61be-49b9-b97f-6e57b5b3f79a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94841eb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce'): ({'sdh'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Removing single pathed devices sdh {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-31f25452-3641-47ce-ac8f-7d28199b7bf2 req-b100def7-671e-4bc0-a7e2-0180b8be3818 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-31f25452-3641-47ce-ac8f-7d28199b7bf2 req-b100def7-671e-4bc0-a7e2-0180b8be3818 service nova] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-31f25452-3641-47ce-ac8f-7d28199b7bf2 req-b100def7-671e-4bc0-a7e2-0180b8be3818 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-31f25452-3641-47ce-ac8f-7d28199b7bf2 req-b100def7-671e-4bc0-a7e2-0180b8be3818 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-31f25452-3641-47ce-ac8f-7d28199b7bf2 req-b100def7-671e-4bc0-a7e2-0180b8be3818 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] No waiting events found dispatching network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:16 user nova-compute[74681]: WARNING nova.compute.manager [req-31f25452-3641-47ce-ac8f-7d28199b7bf2 req-b100def7-671e-4bc0-a7e2-0180b8be3818 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received unexpected event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f9718-b7af-443f-a9f5-1d83f8ba959f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9937b6-5b55-4504-839e-957fb1243d95]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Flushing IO for device /dev/sdh {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[314684c1-2580-463e-8908-ded10293fa13]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:16 user nova-compute[74681]: WARNING nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-2444d2a9-2e73-4b49-8a8c-431f68776ab9 for instance with vm_state active and task_state deleting.
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-deleted-b5f52a79-949a-4249-afc8-049040df17a1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:16 user nova-compute[74681]: INFO nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Neutron deleted interface b5f52a79-949a-4249-afc8-049040df17a1; detaching it from the instance and deleting it from the info cache
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [{"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "address": "fa:16:3e:de:7b:ba", "network": {"id": "acd511e3-6c9f-472c-89ea-8361a25c26bf", "bridge": "br-int", "label": "tempest-device-tagging-net2-2126692192", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30bbb3b0-cd", "ovs_interfaceid": "30bbb3b0-cdf3-46b3-b418-e908e295b5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8f9783-22d5-4194-803f-b6b83251cad1]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] SCSI volumes sdh have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Detach interface failed, port_id=b5f52a79-949a-4249-afc8-049040df17a1, reason: Instance ff2064c1-e1bb-4abe-ab33-ced79efbeadc could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-unplugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-deleted-30bbb3b0-cdf3-46b3-b418-e908e295b5b2 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:16 user nova-compute[74681]: INFO nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Neutron deleted interface 30bbb3b0-cdf3-46b3-b418-e908e295b5b2; detaching it from the instance and deleting it from the info cache
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [{"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9336b44-5798-4ac0-ae76-404bc96738a9", "address": "fa:16:3e:f5:e2:94", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9336b44-57", "ovs_interfaceid": "e9336b44-5798-4ac0-ae76-404bc96738a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7e1440-a341-43f6-852e-1e2c4842904d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Detach interface failed, port_id=30bbb3b0-cdf3-46b3-b418-e908e295b5b2, reason: Instance ff2064c1-e1bb-4abe-ab33-ced79efbeadc could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:16 user nova-compute[74681]: WARNING nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-3bca746f-2df6-435e-85c2-f789ea8a5b8f for instance with vm_state active and task_state deleting.
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-unplugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-deleted-e9336b44-5798-4ac0-ae76-404bc96738a9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:16 user nova-compute[74681]: INFO nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Neutron deleted interface e9336b44-5798-4ac0-ae76-404bc96738a9; detaching it from the instance and deleting it from the info cache
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [{"id": "bb1026fe-e425-441b-ad89-37e2d6e125de", "address": "fa:16:3e:40:68:dd", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb1026fe-e4", "ovs_interfaceid": "bb1026fe-e425-441b-ad89-37e2d6e125de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "address": "fa:16:3e:49:b7:23", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6d84664-b4", "ovs_interfaceid": "c6d84664-b42d-4b02-a71a-17c3471e5bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "address": "fa:16:3e:5d:13:9c", "network": {"id": "2b4edc37-5118-4db8-acd4-aa3c7957bee7", "bridge": "br-int", "label": "tempest-device-tagging-net1-826507029", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "723ad3bf69ae47cd9c3b28f8b4174568", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f6c45b-5d", "ovs_interfaceid": "59f6c45b-5dbf-43f3-936f-fd4280d13103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b596a1c-b390-4d5e-adc9-ab7c32122000]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce, portal: 172.16.0.220,3260]
Aug 16 06:14:16 user nova-compute[74681]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce, portal: 172.16.0.220,3260] successful.
Aug 16 06:14:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-0dca235b-5000-44ff-a39c-037c87ada85d req-c974b8cb-bf75-4641-86d7-40a2aa568e99 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Detach interface failed, port_id=e9336b44-5798-4ac0-ae76-404bc96738a9, reason: Instance ff2064c1-e1bb-4abe-ab33-ced79efbeadc could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb087afb-be48-4a76-92a5-46940f01d7ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156cec0-989c-4042-bb99-41704b931c97]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== disconnect_volume: return (335ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vRBHbPQs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:16 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96918d7-f791-4682-9a82-9a9e30a97a04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04da759-84d4-4142-bbf1-f54f2e614a7b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 (non-flash)
Aug 16 06:14:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948427fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7'): ({'sdi'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Removing single pathed devices sdi {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7990b401-1b6d-42c1-b710-c7433228c2d2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f42edc5-b44c-4790-bf09-7d323fd5e06b]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Flushing IO for device /dev/sdi {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[688282ae-111a-4e86-927e-146bf8bcae84]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e2962c-69fb-48f8-aaee-d3e6f583795a]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] SCSI volumes sdi have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad072b8-8f2f-49bf-9d23-a66bd983121c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b8f4e9-4b22-45dd-a5af-a7b711cb0da5]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7, portal: 172.16.0.220,3260]
Aug 16 06:14:16 user nova-compute[74681]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7, portal: 172.16.0.220,3260] successful.
Aug 16 06:14:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a00e52-852a-4e4b-a35e-cb37c85ba7f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7998ddc-1ef1-42f6-a9be-ead06a6058a9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] <== disconnect_volume: return (334ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:14:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Deleting instance files /opt/stack/data/nova/instances/3a31765d-c4f1-40f6-b63d-ed0830d4bed4_del
Aug 16 06:14:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Deletion of /opt/stack/data/nova/instances/3a31765d-c4f1-40f6-b63d-ed0830d4bed4_del complete
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:16 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Took 7.77 seconds to deallocate network for instance.
Aug 16 06:14:16 user nova-compute[74681]: INFO nova.compute.manager [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Took 4.51 seconds to destroy the instance on the hypervisor.
Aug 16 06:14:16 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:14:16 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166457.013127, 90188af1-901c-453f-b113-133b1e86bc85 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] VM Resumed (Lifecycle Event)
Aug 16 06:14:17 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance spawned successfully.
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:14:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166457.0139902, 90188af1-901c-453f-b113-133b1e86bc85 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] VM Started (Lifecycle Event)
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:14:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:14:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-849601bf-2910-4362-aef8-6790bf8ab49f tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.volume.cinder [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Update attachment failed for attachment 8bdf536f-e977-44b5-95fc-b19778907412. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 was not found.).). (HTTP 500) (Request-ID: req-5321d5d9-0f00-41bd-b423-82f7ab0c77f5) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 was not found.).). (HTTP 500) (Request-ID: req-5321d5d9-0f00-41bd-b423-82f7ab0c77f5)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 was not found.).). (HTTP 500) (Request-ID: req-5321d5d9-0f00-41bd-b423-82f7ab0c77f5)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Traceback (most recent call last):
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/nova/nova/compute/manager.py", line 10766, in _error_out_instance_on_exception
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     yield
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/nova/nova/compute/manager.py", line 6298, in _finish_resize_helper
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     network_info = self._finish_resize(context, instance, migration,
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/nova/nova/compute/manager.py", line 6202, in _finish_resize
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     self._update_volume_attachments(context, instance, bdms)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/nova/nova/compute/manager.py", line 6132, in _update_volume_attachments
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     self.volume_api.attachment_update(
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     res = method(self, ctx, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     with excutils.save_and_reraise_exception():
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     self.force_reraise()
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     raise self.value
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     return method.func(obj, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     resp = self._update('/attachments/%s' % id, body)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     return self.request(url, method, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc]     raise exceptions.from_response(resp, body)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 was not found.).). (HTTP 500) (Request-ID: req-5321d5d9-0f00-41bd-b423-82f7ab0c77f5)
Aug 16 06:14:18 user nova-compute[74681]: ERROR nova.compute.manager [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] 
Aug 16 06:14:18 user nova-compute[74681]: INFO nova.compute.manager [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:18 user nova-compute[74681]: WARNING nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 for instance with vm_state active and task_state deleting.
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-unplugged-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-unplugged-048cf7d9-d093-41eb-b546-a00c669a3dab for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Received event network-vif-deleted-59f6c45b-5dbf-43f3-936f-fd4280d13103 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Acquiring lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] No waiting events found dispatching network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:18 user nova-compute[74681]: WARNING nova.compute.manager [req-c2642ba0-091c-4ae8-b23a-162e07c0f62b req-54ddea14-82e5-4f25-b3cb-555fc8746d10 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received unexpected event network-vif-plugged-048cf7d9-d093-41eb-b546-a00c669a3dab for instance with vm_state active and task_state deleting.
Aug 16 06:14:18 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Deleted allocation for migration 2e109d1c-ba77-4e53-a8f8-82b6cc6e64bb
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:14:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:18 user nova-compute[74681]: INFO nova.compute.manager [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Successfully reverted task state from resize_finish on failure for instance.
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server [None req-843013e1-68f6-46e1-bc67-adf50b0e39a0 tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 was not found.).). (HTTP 500) (Request-ID: req-5321d5d9-0f00-41bd-b423-82f7ab0c77f5)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6268, in finish_resize
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6265, in finish_resize
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6298, in _finish_resize_helper
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6202, in _finish_resize
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6132, in _update_volume_attachments
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d2dce38e-94a3-4add-83f4-8d153c6adad7 was not found.).). (HTTP 500) (Request-ID: req-5321d5d9-0f00-41bd-b423-82f7ab0c77f5)
Aug 16 06:14:18 user nova-compute[74681]: ERROR oslo_messaging.rpc.server 
Aug 16 06:14:19 user nova-compute[74681]: INFO nova.compute.manager [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Took 2.79 seconds to detach 3 volumes for instance.
Aug 16 06:14:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:20 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Deleted allocations for instance ff2064c1-e1bb-4abe-ab33-ced79efbeadc
Aug 16 06:14:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15ba295f-8162-45d2-9e73-b787387ba258 tempest-TaggedBootDevicesTest-1486639203 tempest-TaggedBootDevicesTest-1486639203-project-member] Lock "ff2064c1-e1bb-4abe-ab33-ced79efbeadc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.495s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-deleted-7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:20 user nova-compute[74681]: INFO nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Neutron deleted interface 7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4; detaching it from the instance and deleting it from the info cache
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.network.neutron [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [{"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "address": "fa:16:3e:cf:91:86", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bb0411a-1c", "ovs_interfaceid": "9bb0411a-1cc3-491e-92a5-c5e54215a898", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Detach interface failed, port_id=7fb6de23-b3a1-4a15-b0a4-3c6252ce8fe4, reason: Instance 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-deleted-9bb0411a-1cc3-491e-92a5-c5e54215a898 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:20 user nova-compute[74681]: INFO nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Neutron deleted interface 9bb0411a-1cc3-491e-92a5-c5e54215a898; detaching it from the instance and deleting it from the info cache
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.network.neutron [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [{"id": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "address": "fa:16:3e:44:79:94", "network": {"id": "97119a6b-434e-442f-8757-a206b3c983c9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1679263129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2444d2a9-2e", "ovs_interfaceid": "2444d2a9-2e73-4b49-8a8c-431f68776ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Detach interface failed, port_id=9bb0411a-1cc3-491e-92a5-c5e54215a898, reason: Instance 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-deleted-2444d2a9-2e73-4b49-8a8c-431f68776ab9 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:20 user nova-compute[74681]: INFO nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Neutron deleted interface 2444d2a9-2e73-4b49-8a8c-431f68776ab9; detaching it from the instance and deleting it from the info cache
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.network.neutron [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [{"id": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "address": "fa:16:3e:ad:01:18", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bca746f-2d", "ovs_interfaceid": "3bca746f-2df6-435e-85c2-f789ea8a5b8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "14771914-909d-4cb0-a675-0a818671475d", "address": "fa:16:3e:e6:5f:03", "network": {"id": "aee7f3c9-e7bc-4c9e-af56-05e882c59648", "bridge": "br-int", "label": "tempest-device-tagging-net1-1267751259", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14771914-90", "ovs_interfaceid": "14771914-909d-4cb0-a675-0a818671475d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "048cf7d9-d093-41eb-b546-a00c669a3dab", "address": "fa:16:3e:b7:ee:9a", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap048cf7d9-d0", "ovs_interfaceid": "048cf7d9-d093-41eb-b546-a00c669a3dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "368b421b-b98c-4fe9-919b-aa74db34f552", "address": "fa:16:3e:df:7f:66", "network": {"id": "f831dd64-23e0-4f38-8712-af2c107785b7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2013885070", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "83bf6983951747c287a2099077b61233", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368b421b-b9", "ovs_interfaceid": "368b421b-b98c-4fe9-919b-aa74db34f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-ca727fc1-9d32-4f6a-bca5-08871bc9d17e req-476aaf78-4b19-4817-8450-87f25922be50 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Detach interface failed, port_id=2444d2a9-2e73-4b49-8a8c-431f68776ab9, reason: Instance 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166445.6847029, 9791d36b-9111-47c7-aa6d-c86645e1a453 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:20 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] VM Stopped (Lifecycle Event)
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9adb3752-bbee-4503-bada-2931eb462fb4 None None] [instance: 9791d36b-9111-47c7-aa6d-c86645e1a453] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:20 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:20 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Took 4.08 seconds to deallocate network for instance.
Aug 16 06:14:22 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166447.0567954, ff2064c1-e1bb-4abe-ab33-ced79efbeadc => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:22 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] VM Stopped (Lifecycle Event)
Aug 16 06:14:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fad77ae3-c968-4c4e-b096-c1df94994225 None None] [instance: ff2064c1-e1bb-4abe-ab33-ced79efbeadc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-cb67b07d-a61f-4562-99d1-06cef279fe69 req-008c2422-7c3b-46ed-95b5-e1753ed75040 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-deleted-368b421b-b98c-4fe9-919b-aa74db34f552 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-cb67b07d-a61f-4562-99d1-06cef279fe69 req-008c2422-7c3b-46ed-95b5-e1753ed75040 service nova] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Received event network-vif-deleted-048cf7d9-d093-41eb-b546-a00c669a3dab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:23 user nova-compute[74681]: INFO nova.compute.manager [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Took 2.26 seconds to detach 3 volumes for instance.
Aug 16 06:14:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:23 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:14:23 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:14:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:23 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Deleted allocations for instance 3a31765d-c4f1-40f6-b63d-ed0830d4bed4
Aug 16 06:14:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-28189222-9acc-485e-a3d0-2de016ec5f21 tempest-TaggedBootDevicesTest_v242-1526081836 tempest-TaggedBootDevicesTest_v242-1526081836-project-member] Lock "3a31765d-c4f1-40f6-b63d-ed0830d4bed4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.326s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:30 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166455.1441715, 3a31765d-c4f1-40f6-b63d-ed0830d4bed4 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:30 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] VM Stopped (Lifecycle Event)
Aug 16 06:14:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-5aa46e1e-8eaa-456e-b88c-dded27823ff8 None None] [instance: 3a31765d-c4f1-40f6-b63d-ed0830d4bed4] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:14:43 user nova-compute[74681]: INFO nova.compute.claims [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Claim successful on node user
Aug 16 06:14:43 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:14:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:14:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:14:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Creating image(s)
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "/opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "/opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "/opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG nova.policy [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67db7c024361435ab35c316c2dbfb25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e41e4931d94487a89388c76bb16130', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.219s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.195s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk 1073741824" returned: 0 in 0.053s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:44 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Successfully created port: 7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Cannot resize image /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lazy-loading 'migration_context' on Instance uuid 1790612d-e3f8-4f16-8b6a-74fc37df9d25 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Ensure instance console log exists: /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:45 user nova-compute[74681]: INFO nova.compute.manager [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Detaching volume 2ceb578a-53e8-49b1-a5a7-512c5031efa1
Aug 16 06:14:45 user nova-compute[74681]: INFO nova.virt.block_device [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Attempting to driver detach volume 2ceb578a-53e8-49b1-a5a7-512c5031efa1 from mountpoint /dev/vdb
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Attempting to detach device vdb from instance 3fa19b27-7628-44ce-b0ae-e1e870337855 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:14:45 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:14:45 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:14:45 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:14:45 user nova-compute[74681]:   <serial>2ceb578a-53e8-49b1-a5a7-512c5031efa1</serial>
Aug 16 06:14:45 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:14:45 user nova-compute[74681]: </disk>
Aug 16 06:14:45 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:14:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully detached device vdb from instance 3fa19b27-7628-44ce-b0ae-e1e870337855 from the persistent domain config.
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fa19b27-7628-44ce-b0ae-e1e870337855 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:14:45 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:14:45 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:14:45 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:14:45 user nova-compute[74681]:   <serial>2ceb578a-53e8-49b1-a5a7-512c5031efa1</serial>
Aug 16 06:14:45 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:14:45 user nova-compute[74681]: </disk>
Aug 16 06:14:45 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166485.7654996, 3fa19b27-7628-44ce-b0ae-e1e870337855 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fa19b27-7628-44ce-b0ae-e1e870337855 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:14:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully detached device vdb from instance 3fa19b27-7628-44ce-b0ae-e1e870337855 from the live domain config.
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heTQczMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:14:45 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f4abac-ed69-48f1-b701-664df0712d52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Successfully updated port: 7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "refresh_cache-1790612d-e3f8-4f16-8b6a-74fc37df9d25" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquired lock "refresh_cache-1790612d-e3f8-4f16-8b6a-74fc37df9d25" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[73421b51-b899-4055-8848-3802aab051c9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:45 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:45 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:14:45 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:14:45 user nova-compute[74681]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 (non-flash)
Aug 16 06:14:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94841e8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-1a02a454-62c5-47f2-9943-da5901709cf3 req-29e7e29d-ae67-45a7-9742-70596470d330 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received event network-changed-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-1a02a454-62c5-47f2-9943-da5901709cf3 req-29e7e29d-ae67-45a7-9742-70596470d330 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Refreshing instance network info cache due to event network-changed-7333dc90-1346-4215-914a-1949024fb267. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1a02a454-62c5-47f2-9943-da5901709cf3 req-29e7e29d-ae67-45a7-9742-70596470d330 service nova] Acquiring lock "refresh_cache-1790612d-e3f8-4f16-8b6a-74fc37df9d25" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[32075afd-8cbf-47af-871b-8d6de9b1f0b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcb439e-f0fb-4579-85ed-05ca9d0ce6cb]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2924aa-fbd7-469c-9889-2c742387ff26]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[03094ccc-df90-4b68-9928-de2abd376a5b]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:14:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b0331e-2d62-432a-87d6-6cb2ef8b4d31]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e3bfd1-324f-4b3c-a162-bd5d373098d1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1, portal: 172.16.0.220,3260]
Aug 16 06:14:46 user nova-compute[74681]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1, portal: 172.16.0.220,3260] successful.
Aug 16 06:14:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ceb578a-53e8-49b1-a5a7-512c5031efa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd27439-e669-44be-a2b6-b5598007fa2f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== disconnect_volume: return (315ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Updating instance_info_cache with network_info: [{"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Releasing lock "refresh_cache-1790612d-e3f8-4f16-8b6a-74fc37df9d25" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Instance network_info: |[{"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1a02a454-62c5-47f2-9943-da5901709cf3 req-29e7e29d-ae67-45a7-9742-70596470d330 service nova] Acquired lock "refresh_cache-1790612d-e3f8-4f16-8b6a-74fc37df9d25" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-1a02a454-62c5-47f2-9943-da5901709cf3 req-29e7e29d-ae67-45a7-9742-70596470d330 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Refreshing network info cache for port 7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Start _get_guest_xml network_info=[{"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:14:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:14:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1145243347',display_name='tempest-DeleteServersTestJSON-server-1145243347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1145243347',id=16,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56e41e4931d94487a89388c76bb16130',ramdisk_id='',reservation_id='r-oo6sofqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1316362224',owner_user_name='tempest-DeleteServersTestJSON-1316362224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:14:44Z,user_data=None,user_id='67db7c024361435ab35c316c2dbfb25b',uuid=1790612d-e3f8-4f16-8b6a-74fc37df9d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Converting VIF {"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e9:35,bridge_name='br-int',has_traffic_filtering=True,id=7333dc90-1346-4215-914a-1949024fb267,network=Network(9d4d591c-2994-4341-8dcd-62038d89982d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7333dc90-13') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lazy-loading 'pci_devices' on Instance uuid 1790612d-e3f8-4f16-8b6a-74fc37df9d25 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:14:46 user nova-compute[74681]:   <uuid>1790612d-e3f8-4f16-8b6a-74fc37df9d25</uuid>
Aug 16 06:14:46 user nova-compute[74681]:   <name>instance-00000010</name>
Aug 16 06:14:46 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:14:46 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:14:46 user nova-compute[74681]:   <metadata>
Aug 16 06:14:46 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:14:46 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:14:46 user nova-compute[74681]:       <nova:name>tempest-DeleteServersTestJSON-server-1145243347</nova:name>
Aug 16 06:14:46 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:14:46</nova:creationTime>
Aug 16 06:14:46 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:14:46 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:14:46 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:14:46 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:14:46 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:14:46 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:14:46 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:14:46 user nova-compute[74681]:       <nova:owner>
Aug 16 06:14:46 user nova-compute[74681]:         <nova:user uuid="67db7c024361435ab35c316c2dbfb25b">tempest-DeleteServersTestJSON-1316362224-project-member</nova:user>
Aug 16 06:14:46 user nova-compute[74681]:         <nova:project uuid="56e41e4931d94487a89388c76bb16130">tempest-DeleteServersTestJSON-1316362224</nova:project>
Aug 16 06:14:46 user nova-compute[74681]:       </nova:owner>
Aug 16 06:14:46 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:14:46 user nova-compute[74681]:       <nova:ports>
Aug 16 06:14:46 user nova-compute[74681]:         <nova:port uuid="7333dc90-1346-4215-914a-1949024fb267">
Aug 16 06:14:46 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 06:14:46 user nova-compute[74681]:         </nova:port>
Aug 16 06:14:46 user nova-compute[74681]:       </nova:ports>
Aug 16 06:14:46 user nova-compute[74681]:     </nova:instance>
Aug 16 06:14:46 user nova-compute[74681]:   </metadata>
Aug 16 06:14:46 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:14:46 user nova-compute[74681]:     <system>
Aug 16 06:14:46 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:14:46 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:14:46 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:14:46 user nova-compute[74681]:       <entry name="serial">1790612d-e3f8-4f16-8b6a-74fc37df9d25</entry>
Aug 16 06:14:46 user nova-compute[74681]:       <entry name="uuid">1790612d-e3f8-4f16-8b6a-74fc37df9d25</entry>
Aug 16 06:14:46 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:14:46 user nova-compute[74681]:     </system>
Aug 16 06:14:46 user nova-compute[74681]:   </sysinfo>
Aug 16 06:14:46 user nova-compute[74681]:   <os>
Aug 16 06:14:46 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:14:46 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:14:46 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:14:46 user nova-compute[74681]:   </os>
Aug 16 06:14:46 user nova-compute[74681]:   <features>
Aug 16 06:14:46 user nova-compute[74681]:     <acpi/>
Aug 16 06:14:46 user nova-compute[74681]:     <apic/>
Aug 16 06:14:46 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:14:46 user nova-compute[74681]:   </features>
Aug 16 06:14:46 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:14:46 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:14:46 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:14:46 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:14:46 user nova-compute[74681]:   </clock>
Aug 16 06:14:46 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:14:46 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:14:46 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:14:46 user nova-compute[74681]:   </cpu>
Aug 16 06:14:46 user nova-compute[74681]:   <devices>
Aug 16 06:14:46 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:14:46 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:14:46 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk"/>
Aug 16 06:14:46 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:14:46 user nova-compute[74681]:     </disk>
Aug 16 06:14:46 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:14:46 user nova-compute[74681]:       <mac address="fa:16:3e:cb:e9:35"/>
Aug 16 06:14:46 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:14:46 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:14:46 user nova-compute[74681]:       <target dev="tap7333dc90-13"/>
Aug 16 06:14:46 user nova-compute[74681]:     </interface>
Aug 16 06:14:46 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:14:46 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/console.log" append="off"/>
Aug 16 06:14:46 user nova-compute[74681]:     </serial>
Aug 16 06:14:46 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:14:46 user nova-compute[74681]:     <video>
Aug 16 06:14:46 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:14:46 user nova-compute[74681]:     </video>
Aug 16 06:14:46 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:14:46 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:14:46 user nova-compute[74681]:     </rng>
Aug 16 06:14:46 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:14:46 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:14:46 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:14:46 user nova-compute[74681]:     </memballoon>
Aug 16 06:14:46 user nova-compute[74681]:   </devices>
Aug 16 06:14:46 user nova-compute[74681]: </domain>
Aug 16 06:14:46 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1145243347',display_name='tempest-DeleteServersTestJSON-server-1145243347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1145243347',id=16,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56e41e4931d94487a89388c76bb16130',ramdisk_id='',reservation_id='r-oo6sofqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1316362224',owner_user_name='tempest-DeleteServersTestJSON-1316362224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:14:44Z,user_data=None,user_id='67db7c024361435ab35c316c2dbfb25b',uuid=1790612d-e3f8-4f16-8b6a-74fc37df9d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Converting VIF {"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e9:35,bridge_name='br-int',has_traffic_filtering=True,id=7333dc90-1346-4215-914a-1949024fb267,network=Network(9d4d591c-2994-4341-8dcd-62038d89982d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7333dc90-13') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG os_vif [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e9:35,bridge_name='br-int',has_traffic_filtering=True,id=7333dc90-1346-4215-914a-1949024fb267,network=Network(9d4d591c-2994-4341-8dcd-62038d89982d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7333dc90-13') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7333dc90-13, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7333dc90-13, col_values=(('external_ids', {'iface-id': '7333dc90-1346-4215-914a-1949024fb267', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:e9:35', 'vm-uuid': '1790612d-e3f8-4f16-8b6a-74fc37df9d25'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:46 user nova-compute[74681]: INFO os_vif [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e9:35,bridge_name='br-int',has_traffic_filtering=True,id=7333dc90-1346-4215-914a-1949024fb267,network=Network(9d4d591c-2994-4341-8dcd-62038d89982d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7333dc90-13')
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] No VIF found with MAC fa:16:3e:cb:e9:35, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-1a02a454-62c5-47f2-9943-da5901709cf3 req-29e7e29d-ae67-45a7-9742-70596470d330 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Updated VIF entry in instance network info cache for port 7333dc90-1346-4215-914a-1949024fb267. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-1a02a454-62c5-47f2-9943-da5901709cf3 req-29e7e29d-ae67-45a7-9742-70596470d330 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Updating instance_info_cache with network_info: [{"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 3fa19b27-7628-44ce-b0ae-e1e870337855 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1a02a454-62c5-47f2-9943-da5901709cf3 req-29e7e29d-ae67-45a7-9742-70596470d330 service nova] Releasing lock "refresh_cache-1790612d-e3f8-4f16-8b6a-74fc37df9d25" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-507d6056-a890-47b5-8791-cbe01f81cf5f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.722s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [{"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-90188af1-901c-453f-b113-133b1e86bc85" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-990c2ce2-671e-49e2-bb06-fbe037ca039c req-5207f391-cd21-4c56-aa42-694f6285f427 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received event network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-990c2ce2-671e-49e2-bb06-fbe037ca039c req-5207f391-cd21-4c56-aa42-694f6285f427 service nova] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-990c2ce2-671e-49e2-bb06-fbe037ca039c req-5207f391-cd21-4c56-aa42-694f6285f427 service nova] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-990c2ce2-671e-49e2-bb06-fbe037ca039c req-5207f391-cd21-4c56-aa42-694f6285f427 service nova] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-990c2ce2-671e-49e2-bb06-fbe037ca039c req-5207f391-cd21-4c56-aa42-694f6285f427 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] No waiting events found dispatching network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:48 user nova-compute[74681]: WARNING nova.compute.manager [req-990c2ce2-671e-49e2-bb06-fbe037ca039c req-5207f391-cd21-4c56-aa42-694f6285f427 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received unexpected event network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 for instance with vm_state building and task_state spawning.
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:49 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166489.9754949, 1790612d-e3f8-4f16-8b6a-74fc37df9d25 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] VM Resumed (Lifecycle Event)
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:14:50 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Instance spawned successfully.
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:14:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166489.9764252, 1790612d-e3f8-4f16-8b6a-74fc37df9d25 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:14:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] VM Started (Lifecycle Event)
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-2733e208-9e10-4b2b-9789-49bddcef5768 req-fca0386d-1104-4680-bfdf-6d5326a0d631 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received event network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2733e208-9e10-4b2b-9789-49bddcef5768 req-fca0386d-1104-4680-bfdf-6d5326a0d631 service nova] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2733e208-9e10-4b2b-9789-49bddcef5768 req-fca0386d-1104-4680-bfdf-6d5326a0d631 service nova] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2733e208-9e10-4b2b-9789-49bddcef5768 req-fca0386d-1104-4680-bfdf-6d5326a0d631 service nova] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-2733e208-9e10-4b2b-9789-49bddcef5768 req-fca0386d-1104-4680-bfdf-6d5326a0d631 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] No waiting events found dispatching network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:50 user nova-compute[74681]: WARNING nova.compute.manager [req-2733e208-9e10-4b2b-9789-49bddcef5768 req-fca0386d-1104-4680-bfdf-6d5326a0d631 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received unexpected event network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 for instance with vm_state building and task_state spawning.
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:14:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:50 user nova-compute[74681]: INFO nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 16 06:14:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:14:50 user nova-compute[74681]: INFO nova.compute.manager [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Took 6.78 seconds to build instance.
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1821858d-8337-426e-bbee-ff259a97f88d tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.914s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:52 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:14:52 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7640MB free_disk=25.578601837158203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Applying migration context for instance 70390b89-fdfb-4552-98e5-35568c0268bc as it has an incoming, in-progress migration 2e109d1c-ba77-4e53-a8f8-82b6cc6e64bb. Migration status is error {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=74681) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3fa19b27-7628-44ce-b0ae-e1e870337855 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance d7bc97ea-3b81-488c-8c63-b83a351118d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4f6a4167-51f1-4d02-b37b-a031af00ef7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 90188af1-901c-453f-b113-133b1e86bc85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 70390b89-fdfb-4552-98e5-35568c0268bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 1790612d-e3f8-4f16-8b6a-74fc37df9d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:14:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:14:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:53 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:14:53 user nova-compute[74681]: INFO nova.compute.claims [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Claim successful on node user
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.network.neutron [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:14:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.policy [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '790c60ee58a549ddaabd5f0badcb77fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845526507c1a4a9eadc6c45271cceb94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:14:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Creating image(s)
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "/opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "/opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.197s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk 1073741824" returned: 0 in 0.055s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Successfully created port: 395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.203s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Cannot resize image /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG nova.objects.instance [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'migration_context' on Instance uuid 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Ensure instance console log exists: /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Successfully updated port: 395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquired lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.compute.manager [req-4b893cee-c698-4e31-8ff7-6eb7510a24e6 req-ff66f20a-c171-422a-8d9b-7b2bc810c7cd service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-changed-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.compute.manager [req-4b893cee-c698-4e31-8ff7-6eb7510a24e6 req-ff66f20a-c171-422a-8d9b-7b2bc810c7cd service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Refreshing instance network info cache due to event network-changed-395eef1a-74ab-41c3-b9d0-db18c0cfbb82. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b893cee-c698-4e31-8ff7-6eb7510a24e6 req-ff66f20a-c171-422a-8d9b-7b2bc810c7cd service nova] Acquiring lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Releasing lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Instance network_info: |[{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b893cee-c698-4e31-8ff7-6eb7510a24e6 req-ff66f20a-c171-422a-8d9b-7b2bc810c7cd service nova] Acquired lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.neutron [req-4b893cee-c698-4e31-8ff7-6eb7510a24e6 req-ff66f20a-c171-422a-8d9b-7b2bc810c7cd service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Refreshing network info cache for port 395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Start _get_guest_xml network_info=[{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:14:56 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:14:56 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1460264594',display_name='tempest-ServerActionsTestOtherA-server-1460264594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1460264594',id=17,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-cso4fy4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=5fc4c990-cc82-410a-b3fc-f931aa20b9b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:aa:7a,bridge_name='br-int',has_traffic_filtering=True,id=395eef1a-74ab-41c3-b9d0-db18c0cfbb82,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395eef1a-74') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:14:56 user nova-compute[74681]:   <uuid>5fc4c990-cc82-410a-b3fc-f931aa20b9b3</uuid>
Aug 16 06:14:56 user nova-compute[74681]:   <name>instance-00000011</name>
Aug 16 06:14:56 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:14:56 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:14:56 user nova-compute[74681]:   <metadata>
Aug 16 06:14:56 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:14:56 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:14:56 user nova-compute[74681]:       <nova:name>tempest-ServerActionsTestOtherA-server-1460264594</nova:name>
Aug 16 06:14:56 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:14:56</nova:creationTime>
Aug 16 06:14:56 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:14:56 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:14:56 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:14:56 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:14:56 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:14:56 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:14:56 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:14:56 user nova-compute[74681]:       <nova:owner>
Aug 16 06:14:56 user nova-compute[74681]:         <nova:user uuid="790c60ee58a549ddaabd5f0badcb77fe">tempest-ServerActionsTestOtherA-2037182259-project-member</nova:user>
Aug 16 06:14:56 user nova-compute[74681]:         <nova:project uuid="845526507c1a4a9eadc6c45271cceb94">tempest-ServerActionsTestOtherA-2037182259</nova:project>
Aug 16 06:14:56 user nova-compute[74681]:       </nova:owner>
Aug 16 06:14:56 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:14:56 user nova-compute[74681]:       <nova:ports>
Aug 16 06:14:56 user nova-compute[74681]:         <nova:port uuid="395eef1a-74ab-41c3-b9d0-db18c0cfbb82">
Aug 16 06:14:56 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 06:14:56 user nova-compute[74681]:         </nova:port>
Aug 16 06:14:56 user nova-compute[74681]:       </nova:ports>
Aug 16 06:14:56 user nova-compute[74681]:     </nova:instance>
Aug 16 06:14:56 user nova-compute[74681]:   </metadata>
Aug 16 06:14:56 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:14:56 user nova-compute[74681]:     <system>
Aug 16 06:14:56 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:14:56 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:14:56 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:14:56 user nova-compute[74681]:       <entry name="serial">5fc4c990-cc82-410a-b3fc-f931aa20b9b3</entry>
Aug 16 06:14:56 user nova-compute[74681]:       <entry name="uuid">5fc4c990-cc82-410a-b3fc-f931aa20b9b3</entry>
Aug 16 06:14:56 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:14:56 user nova-compute[74681]:     </system>
Aug 16 06:14:56 user nova-compute[74681]:   </sysinfo>
Aug 16 06:14:56 user nova-compute[74681]:   <os>
Aug 16 06:14:56 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:14:56 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:14:56 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:14:56 user nova-compute[74681]:   </os>
Aug 16 06:14:56 user nova-compute[74681]:   <features>
Aug 16 06:14:56 user nova-compute[74681]:     <acpi/>
Aug 16 06:14:56 user nova-compute[74681]:     <apic/>
Aug 16 06:14:56 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:14:56 user nova-compute[74681]:   </features>
Aug 16 06:14:56 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:14:56 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:14:56 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:14:56 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:14:56 user nova-compute[74681]:   </clock>
Aug 16 06:14:56 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:14:56 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:14:56 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:14:56 user nova-compute[74681]:   </cpu>
Aug 16 06:14:56 user nova-compute[74681]:   <devices>
Aug 16 06:14:56 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:14:56 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:14:56 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk"/>
Aug 16 06:14:56 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:14:56 user nova-compute[74681]:     </disk>
Aug 16 06:14:56 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:14:56 user nova-compute[74681]:       <mac address="fa:16:3e:d2:aa:7a"/>
Aug 16 06:14:56 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:14:56 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:14:56 user nova-compute[74681]:       <target dev="tap395eef1a-74"/>
Aug 16 06:14:56 user nova-compute[74681]:     </interface>
Aug 16 06:14:56 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:14:56 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/console.log" append="off"/>
Aug 16 06:14:56 user nova-compute[74681]:     </serial>
Aug 16 06:14:56 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:14:56 user nova-compute[74681]:     <video>
Aug 16 06:14:56 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:14:56 user nova-compute[74681]:     </video>
Aug 16 06:14:56 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:14:56 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:14:56 user nova-compute[74681]:     </rng>
Aug 16 06:14:56 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:14:56 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:14:56 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:14:56 user nova-compute[74681]:     </memballoon>
Aug 16 06:14:56 user nova-compute[74681]:   </devices>
Aug 16 06:14:56 user nova-compute[74681]: </domain>
Aug 16 06:14:56 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1460264594',display_name='tempest-ServerActionsTestOtherA-server-1460264594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1460264594',id=17,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-cso4fy4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:14:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=5fc4c990-cc82-410a-b3fc-f931aa20b9b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:aa:7a,bridge_name='br-int',has_traffic_filtering=True,id=395eef1a-74ab-41c3-b9d0-db18c0cfbb82,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395eef1a-74') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG os_vif [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:aa:7a,bridge_name='br-int',has_traffic_filtering=True,id=395eef1a-74ab-41c3-b9d0-db18c0cfbb82,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395eef1a-74') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap395eef1a-74, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap395eef1a-74, col_values=(('external_ids', {'iface-id': '395eef1a-74ab-41c3-b9d0-db18c0cfbb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:aa:7a', 'vm-uuid': '5fc4c990-cc82-410a-b3fc-f931aa20b9b3'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:14:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:57 user nova-compute[74681]: INFO os_vif [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:aa:7a,bridge_name='br-int',has_traffic_filtering=True,id=395eef1a-74ab-41c3-b9d0-db18c0cfbb82,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395eef1a-74')
Aug 16 06:14:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:14:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No VIF found with MAC fa:16:3e:d2:aa:7a, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:14:57 user nova-compute[74681]: DEBUG nova.network.neutron [req-4b893cee-c698-4e31-8ff7-6eb7510a24e6 req-ff66f20a-c171-422a-8d9b-7b2bc810c7cd service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updated VIF entry in instance network info cache for port 395eef1a-74ab-41c3-b9d0-db18c0cfbb82. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:14:57 user nova-compute[74681]: DEBUG nova.network.neutron [req-4b893cee-c698-4e31-8ff7-6eb7510a24e6 req-ff66f20a-c171-422a-8d9b-7b2bc810c7cd service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:14:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b893cee-c698-4e31-8ff7-6eb7510a24e6 req-ff66f20a-c171-422a-8d9b-7b2bc810c7cd service nova] Releasing lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-ab66686e-56cb-4062-ad8b-cf8d569bce5c req-fde4789a-d724-4202-986d-f47343d418c1 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab66686e-56cb-4062-ad8b-cf8d569bce5c req-fde4789a-d724-4202-986d-f47343d418c1 service nova] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab66686e-56cb-4062-ad8b-cf8d569bce5c req-fde4789a-d724-4202-986d-f47343d418c1 service nova] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab66686e-56cb-4062-ad8b-cf8d569bce5c req-fde4789a-d724-4202-986d-f47343d418c1 service nova] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:14:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-ab66686e-56cb-4062-ad8b-cf8d569bce5c req-fde4789a-d724-4202-986d-f47343d418c1 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] No waiting events found dispatching network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:14:58 user nova-compute[74681]: WARNING nova.compute.manager [req-ab66686e-56cb-4062-ad8b-cf8d569bce5c req-fde4789a-d724-4202-986d-f47343d418c1 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received unexpected event network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 for instance with vm_state building and task_state spawning.
Aug 16 06:14:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:14:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-3060ab57-4352-4183-8dc9-367cb5c174a4 req-9bf2132d-c7d0-4f87-aeb4-6cfecbb27e0c service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3060ab57-4352-4183-8dc9-367cb5c174a4 req-9bf2132d-c7d0-4f87-aeb4-6cfecbb27e0c service nova] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3060ab57-4352-4183-8dc9-367cb5c174a4 req-9bf2132d-c7d0-4f87-aeb4-6cfecbb27e0c service nova] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3060ab57-4352-4183-8dc9-367cb5c174a4 req-9bf2132d-c7d0-4f87-aeb4-6cfecbb27e0c service nova] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-3060ab57-4352-4183-8dc9-367cb5c174a4 req-9bf2132d-c7d0-4f87-aeb4-6cfecbb27e0c service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] No waiting events found dispatching network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:00 user nova-compute[74681]: WARNING nova.compute.manager [req-3060ab57-4352-4183-8dc9-367cb5c174a4 req-9bf2132d-c7d0-4f87-aeb4-6cfecbb27e0c service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received unexpected event network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 for instance with vm_state building and task_state spawning.
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166500.8750625, 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:15:00 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] VM Resumed (Lifecycle Event)
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:15:00 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Instance spawned successfully.
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:00 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:15:00 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166500.8757923, 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:15:00 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] VM Started (Lifecycle Event)
Aug 16 06:15:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:15:01 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:15:01 user nova-compute[74681]: INFO nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 16 06:15:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:01 user nova-compute[74681]: INFO nova.compute.manager [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Took 7.32 seconds to build instance.
Aug 16 06:15:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-58563d3d-d08c-44fa-9fb2-4fcb7288c89c tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.446s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:26 user nova-compute[74681]: INFO nova.compute.manager [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Terminating instance
Aug 16 06:15:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:15:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Instance destroyed successfully.
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'resources' on Instance uuid 4f6a4167-51f1-4d02-b37b-a031af00ef7b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:13:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-145353915',display_name='tempest-VolumesAdminNegativeTest-server-145353915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-145353915',id=15,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:13:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c36ac064a14486eb8673f39338119db',ramdisk_id='',reservation_id='r-9fg3a9u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-128005769',owner_user_name='tempest-VolumesAdminNegativeTest-128005769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:13:31Z,user_data=None,user_id='d15ba1a73e62426c97713c02fd1c31fb',uuid=4f6a4167-51f1-4d02-b37b-a031af00ef7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converting VIF {"id": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "address": "fa:16:3e:61:cd:97", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba580f27-78", "ovs_interfaceid": "ba580f27-78aa-49fc-b03b-0169f33ee18b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:cd:97,bridge_name='br-int',has_traffic_filtering=True,id=ba580f27-78aa-49fc-b03b-0169f33ee18b,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba580f27-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG os_vif [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:cd:97,bridge_name='br-int',has_traffic_filtering=True,id=ba580f27-78aa-49fc-b03b-0169f33ee18b,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba580f27-78') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba580f27-78, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:15:27 user nova-compute[74681]: INFO os_vif [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:cd:97,bridge_name='br-int',has_traffic_filtering=True,id=ba580f27-78aa-49fc-b03b-0169f33ee18b,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba580f27-78')
Aug 16 06:15:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Deleting instance files /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b_del
Aug 16 06:15:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Deletion of /opt/stack/data/nova/instances/4f6a4167-51f1-4d02-b37b-a031af00ef7b_del complete
Aug 16 06:15:27 user nova-compute[74681]: INFO nova.compute.manager [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 16 06:15:27 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-d89a2f91-d98b-4366-b44a-6609101506d5 req-07f36b06-ad18-431f-9ebc-920eec9be178 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received event network-vif-unplugged-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d89a2f91-d98b-4366-b44a-6609101506d5 req-07f36b06-ad18-431f-9ebc-920eec9be178 service nova] Acquiring lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d89a2f91-d98b-4366-b44a-6609101506d5 req-07f36b06-ad18-431f-9ebc-920eec9be178 service nova] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d89a2f91-d98b-4366-b44a-6609101506d5 req-07f36b06-ad18-431f-9ebc-920eec9be178 service nova] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-d89a2f91-d98b-4366-b44a-6609101506d5 req-07f36b06-ad18-431f-9ebc-920eec9be178 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] No waiting events found dispatching network-vif-unplugged-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-d89a2f91-d98b-4366-b44a-6609101506d5 req-07f36b06-ad18-431f-9ebc-920eec9be178 service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received event network-vif-unplugged-ba580f27-78aa-49fc-b03b-0169f33ee18b for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:15:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:28 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:28 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Took 1.35 seconds to deallocate network for instance.
Aug 16 06:15:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:29 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:15:29 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:15:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:29 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Deleted allocations for instance 4f6a4167-51f1-4d02-b37b-a031af00ef7b
Aug 16 06:15:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e6088fad-9b01-48a6-9fdb-20c4493d0748 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-d82abf37-e615-4fca-8efa-205bc6913e43 req-9aeee339-a024-4c3e-918f-cd8bcb726fde service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received event network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d82abf37-e615-4fca-8efa-205bc6913e43 req-9aeee339-a024-4c3e-918f-cd8bcb726fde service nova] Acquiring lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d82abf37-e615-4fca-8efa-205bc6913e43 req-9aeee339-a024-4c3e-918f-cd8bcb726fde service nova] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d82abf37-e615-4fca-8efa-205bc6913e43 req-9aeee339-a024-4c3e-918f-cd8bcb726fde service nova] Lock "4f6a4167-51f1-4d02-b37b-a031af00ef7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-d82abf37-e615-4fca-8efa-205bc6913e43 req-9aeee339-a024-4c3e-918f-cd8bcb726fde service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] No waiting events found dispatching network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:29 user nova-compute[74681]: WARNING nova.compute.manager [req-d82abf37-e615-4fca-8efa-205bc6913e43 req-9aeee339-a024-4c3e-918f-cd8bcb726fde service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received unexpected event network-vif-plugged-ba580f27-78aa-49fc-b03b-0169f33ee18b for instance with vm_state deleted and task_state None.
Aug 16 06:15:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-d82abf37-e615-4fca-8efa-205bc6913e43 req-9aeee339-a024-4c3e-918f-cd8bcb726fde service nova] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Received event network-vif-deleted-ba580f27-78aa-49fc-b03b-0169f33ee18b {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:33 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:15:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:15:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:15:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:15:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updating instance_info_cache with network_info: [{"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-6fa74c3d-f621-4cf2-8763-6d75109fb113" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:15:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:35 user nova-compute[74681]: INFO nova.compute.manager [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Terminating instance
Aug 16 06:15:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8530698-9d57-4290-8976-adc92d1e95dc req-cf30c46b-7bbe-44db-bba5-7462725c54f0 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received event network-vif-unplugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8530698-9d57-4290-8976-adc92d1e95dc req-cf30c46b-7bbe-44db-bba5-7462725c54f0 service nova] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8530698-9d57-4290-8976-adc92d1e95dc req-cf30c46b-7bbe-44db-bba5-7462725c54f0 service nova] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8530698-9d57-4290-8976-adc92d1e95dc req-cf30c46b-7bbe-44db-bba5-7462725c54f0 service nova] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8530698-9d57-4290-8976-adc92d1e95dc req-cf30c46b-7bbe-44db-bba5-7462725c54f0 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] No waiting events found dispatching network-vif-unplugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8530698-9d57-4290-8976-adc92d1e95dc req-cf30c46b-7bbe-44db-bba5-7462725c54f0 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received event network-vif-unplugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:15:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Instance destroyed successfully.
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.objects.instance [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'resources' on Instance uuid 3fa19b27-7628-44ce-b0ae-e1e870337855 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000737702',display_name='tempest-AttachVolumeNegativeTest-server-2000737702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000737702',id=2,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxf60vy083dcqDmgKQudfQGFIjNhV71YHeGyBxF0QbvR7KaBEfWovDXqSocEkAHTAC/AAwWpgQ2vEERRiSm5ff+pBQb6MXlJAtj393eFHEdYzSA0EfpEeCYF5MQQsj2RQ==',key_name='tempest-keypair-2001252791',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-9fs7luon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=3fa19b27-7628-44ce-b0ae-e1e870337855,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "address": "fa:16:3e:ec:1c:19", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62d2031-a7", "ovs_interfaceid": "a62d2031-a7e7-4e14-91ce-11c5603ce3b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:1c:19,bridge_name='br-int',has_traffic_filtering=True,id=a62d2031-a7e7-4e14-91ce-11c5603ce3b4,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62d2031-a7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_vif [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:1c:19,bridge_name='br-int',has_traffic_filtering=True,id=a62d2031-a7e7-4e14-91ce-11c5603ce3b4,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62d2031-a7') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa62d2031-a7, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:15:36 user nova-compute[74681]: INFO os_vif [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:1c:19,bridge_name='br-int',has_traffic_filtering=True,id=a62d2031-a7e7-4e14-91ce-11c5603ce3b4,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62d2031-a7')
Aug 16 06:15:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Deleting instance files /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855_del
Aug 16 06:15:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Deletion of /opt/stack/data/nova/instances/3fa19b27-7628-44ce-b0ae-e1e870337855_del complete
Aug 16 06:15:36 user nova-compute[74681]: INFO nova.compute.manager [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:36 user nova-compute[74681]: INFO nova.compute.manager [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Terminating instance
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:15:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance destroyed successfully.
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.objects.instance [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lazy-loading 'resources' on Instance uuid 70390b89-fdfb-4552-98e5-35568c0268bc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-531426131',display_name='tempest-ServerActionsTestOtherB-server-531426131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-531426131',id=3,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWlIoTicQCRzN4ho+jH6G0ba9amolIyK2LT+pFMzFui3SxetiZZayKLGlFWxVg76CqjpfkgyxdZS4PxM2hlDKSKmqhhIQRwcBAryoq1HKw9nWQttQnXQLtyPZgNVZBs/A==',key_name='tempest-keypair-1862071311',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b3563d8bdb54a0aa3862684760dbe3e',ramdisk_id='',reservation_id='r-i4lgm6v5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1555615278',owner_user_name='tempest-ServerActionsTestOtherB-1555615278-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:14:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2e5fe13505244ef92353a7ba756551c',uuid=70390b89-fdfb-4552-98e5-35568c0268bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Converting VIF {"id": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "address": "fa:16:3e:95:96:98", "network": {"id": "9e628cc5-6bcb-4d24-b639-a3a65f49d5e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-928987624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b3563d8bdb54a0aa3862684760dbe3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd431340f-a0", "ovs_interfaceid": "d431340f-a0ca-42db-aa2d-0a1a0e885c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_vif [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd431340f-a0, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:15:36 user nova-compute[74681]: INFO os_vif [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:96:98,bridge_name='br-int',has_traffic_filtering=True,id=d431340f-a0ca-42db-aa2d-0a1a0e885c9c,network=Network(9e628cc5-6bcb-4d24-b639-a3a65f49d5e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd431340f-a0')
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVgzeHyP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:15:36 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66993ddf-9c38-4482-8dd6-cbb00ade162f', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6630a4-332b-46ea-bc61-e9e867002531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b7f53c-ffcd-4903-9220-114860064af4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:15:36 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:15:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:15:36 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:15:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948429e3b0>, {}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Disconnecting from: [] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] <== disconnect_volume: return (51ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:15:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Deletion of /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize failed
Aug 16 06:15:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:36 user nova-compute[74681]: INFO nova.compute.manager [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Took 0.18 seconds to destroy the instance on the hypervisor.
Aug 16 06:15:36 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:15:36 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:15:37 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 06:15:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] There are 0 instances to clean {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-f3e094dc-edad-4844-9aa3-ca7fad698fd0 req-fb760c67-4450-4fd4-a841-9d13e6ca64d5 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received event network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f3e094dc-edad-4844-9aa3-ca7fad698fd0 req-fb760c67-4450-4fd4-a841-9d13e6ca64d5 service nova] Acquiring lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f3e094dc-edad-4844-9aa3-ca7fad698fd0 req-fb760c67-4450-4fd4-a841-9d13e6ca64d5 service nova] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f3e094dc-edad-4844-9aa3-ca7fad698fd0 req-fb760c67-4450-4fd4-a841-9d13e6ca64d5 service nova] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-f3e094dc-edad-4844-9aa3-ca7fad698fd0 req-fb760c67-4450-4fd4-a841-9d13e6ca64d5 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] No waiting events found dispatching network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:38 user nova-compute[74681]: WARNING nova.compute.manager [req-f3e094dc-edad-4844-9aa3-ca7fad698fd0 req-fb760c67-4450-4fd4-a841-9d13e6ca64d5 service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received unexpected event network-vif-plugged-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 for instance with vm_state active and task_state deleting.
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:38 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Took 2.16 seconds to deallocate network for instance.
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-5e7ad4b7-aaee-4b6b-89b5-521dcd350c82 req-bbea4dd5-00a3-49b3-a2d4-8f58c58e7b7d service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Received event network-vif-deleted-a62d2031-a7e7-4e14-91ce-11c5603ce3b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:38 user nova-compute[74681]: INFO nova.compute.manager [req-5e7ad4b7-aaee-4b6b-89b5-521dcd350c82 req-bbea4dd5-00a3-49b3-a2d4-8f58c58e7b7d service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Neutron deleted interface a62d2031-a7e7-4e14-91ce-11c5603ce3b4; detaching it from the instance and deleting it from the info cache
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.network.neutron [req-5e7ad4b7-aaee-4b6b-89b5-521dcd350c82 req-bbea4dd5-00a3-49b3-a2d4-8f58c58e7b7d service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-5e7ad4b7-aaee-4b6b-89b5-521dcd350c82 req-bbea4dd5-00a3-49b3-a2d4-8f58c58e7b7d service nova] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Detach interface failed, port_id=a62d2031-a7e7-4e14-91ce-11c5603ce3b4, reason: Instance 3fa19b27-7628-44ce-b0ae-e1e870337855 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:38 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Took 2.13 seconds to deallocate network for instance.
Aug 16 06:15:38 user nova-compute[74681]: INFO nova.compute.manager [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Took 0.11 seconds to detach 1 volumes for instance.
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.321s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:39 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Deleted allocations for instance 3fa19b27-7628-44ce-b0ae-e1e870337855
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:39 user nova-compute[74681]: INFO nova.compute.manager [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Detaching volume 1842ce72-883c-462a-be3c-2823df2e854b
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5dfea310-8a24-48e6-985d-5d5d49f7fe07 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "3fa19b27-7628-44ce-b0ae-e1e870337855" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.916s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:39 user nova-compute[74681]: INFO nova.virt.block_device [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Attempting to driver detach volume 1842ce72-883c-462a-be3c-2823df2e854b from mountpoint /dev/vdc
Aug 16 06:15:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Attempting to detach device vdc from instance 90188af1-901c-453f-b113-133b1e86bc85 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:15:39 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:15:39 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:15:39 user nova-compute[74681]:   <target dev="vdc" bus="virtio"/>
Aug 16 06:15:39 user nova-compute[74681]:   <serial>1842ce72-883c-462a-be3c-2823df2e854b</serial>
Aug 16 06:15:39 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 06:15:39 user nova-compute[74681]: </disk>
Aug 16 06:15:39 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:15:39 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully detached device vdc from instance 90188af1-901c-453f-b113-133b1e86bc85 from the persistent domain config.
Aug 16 06:15:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 90188af1-901c-453f-b113-133b1e86bc85 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:15:39 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:15:39 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:15:39 user nova-compute[74681]:   <target dev="vdc" bus="virtio"/>
Aug 16 06:15:39 user nova-compute[74681]:   <serial>1842ce72-883c-462a-be3c-2823df2e854b</serial>
Aug 16 06:15:39 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 06:15:39 user nova-compute[74681]: </disk>
Aug 16 06:15:39 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:39 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Deleted allocations for instance 70390b89-fdfb-4552-98e5-35568c0268bc
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-6171a546-fc84-42cc-a7ab-5fbbc6cacaea tempest-ServerActionsTestOtherB-1555615278 tempest-ServerActionsTestOtherB-1555615278-project-member] Lock "70390b89-fdfb-4552-98e5-35568c0268bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.495s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166540.0150418, 90188af1-901c-453f-b113-133b1e86bc85 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:15:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully detached device vdc from instance 90188af1-901c-453f-b113-133b1e86bc85 from the live domain config.
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvrUayuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:15:40 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6939590-3288-4f8a-b562-75d846b00f92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedc48aa-9f26-48ac-a036-8639a92a05b4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:15:40 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:15:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:15:40 user nova-compute[74681]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b (non-flash)
Aug 16 06:15:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f946076e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abb5799-6e3c-4008-adda-7b9821782c58]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71728d-6c07-4f4b-92f8-095fb8e605a4]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[19451645-c57b-4b7c-bf88-525ec629602e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b974d7d5-5b12-4035-88c0-30aeaf44f9b4]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feeac7d-6bec-4cf9-a476-84d762bdc0a4]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:15:40 user nova-compute[74681]: INFO nova.compute.claims [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Claim successful on node user
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa3aadd-316e-49a4-86a1-149eba78b3ed]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b, portal: 172.16.0.220,3260]
Aug 16 06:15:40 user nova-compute[74681]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b, portal: 172.16.0.220,3260] successful.
Aug 16 06:15:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1842ce72-883c-462a-be3c-2823df2e854b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e7531-03ef-4aff-a9ed-441f59bd0cc3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] <== disconnect_volume: return (393ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-728dc8aa-f198-4da9-9a4b-7ae741e1c0f3 req-3ba4a21d-436b-450b-8c68-8c7fcdbd2181 service nova] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Received event network-vif-deleted-d431340f-a0ca-42db-aa2d-0a1a0e885c9c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:15:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:15:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:15:41 user nova-compute[74681]: INFO nova.virt.block_device [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Booting with volume 4ce7b0de-d115-4b09-a780-a23b962bdf2d at /dev/vda
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG nova.policy [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7666caaf93494e07baf06aca64090235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824dea21de1d4cce8d70be10c5a5942b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG os_brick.utils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7649a87-15cb-4bed-ba23-6acd243ea18e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4894303-78de-479e-b47c-f5af6826b635]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'flavor' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8bc7ed-10fd-472b-aeee-a4da6d0c6632]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0434b93e-ed9c-4973-938e-c60b2ee8cdc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:15:41 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f9184e-6f8d-4a49-88c2-c4c2196c26e4]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG os_brick.utils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updating existing volume attachment record: 3dc316e7-771c-435a-a15c-0f7193cf446a {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e398e2d0-d586-4916-a347-474769c67d1e tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.992s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:41 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:15:41 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:15:41 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7582MB free_disk=25.548603057861328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Successfully created port: 7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance d7bc97ea-3b81-488c-8c63-b83a351118d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 90188af1-901c-453f-b113-133b1e86bc85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 1790612d-e3f8-4f16-8b6a-74fc37df9d25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance e7e44f1a-d07e-4b37-bed0-9cf141649d6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing inventories for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating ProviderTree inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing aggregate associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, aggregates: None {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing trait associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166527.4163082, 4f6a4167-51f1-4d02-b37b-a031af00ef7b => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:15:42 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] VM Stopped (Lifecycle Event)
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f7553bb4-35ef-41f6-832b-c764909e0aee None None] [instance: 4f6a4167-51f1-4d02-b37b-a031af00ef7b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74681) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Successfully updated port: 7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquired lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-c1bd8252-c186-4d5f-9f1d-4cc69abed02d req-ba3e0406-cb62-445e-8b35-8c0f53152686 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-changed-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-c1bd8252-c186-4d5f-9f1d-4cc69abed02d req-ba3e0406-cb62-445e-8b35-8c0f53152686 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Refreshing instance network info cache due to event network-changed-7a5e5902-78fd-4339-8aa2-91c8cd2cb239. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1bd8252-c186-4d5f-9f1d-4cc69abed02d req-ba3e0406-cb62-445e-8b35-8c0f53152686 service nova] Acquiring lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:15:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updating instance_info_cache with network_info: [{"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Releasing lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance network_info: |[{"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1bd8252-c186-4d5f-9f1d-4cc69abed02d req-ba3e0406-cb62-445e-8b35-8c0f53152686 service nova] Acquired lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-c1bd8252-c186-4d5f-9f1d-4cc69abed02d req-ba3e0406-cb62-445e-8b35-8c0f53152686 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Refreshing network info cache for port 7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-c1bd8252-c186-4d5f-9f1d-4cc69abed02d req-ba3e0406-cb62-445e-8b35-8c0f53152686 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updated VIF entry in instance network info cache for port 7a5e5902-78fd-4339-8aa2-91c8cd2cb239. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-c1bd8252-c186-4d5f-9f1d-4cc69abed02d req-ba3e0406-cb62-445e-8b35-8c0f53152686 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updating instance_info_cache with network_info: [{"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1bd8252-c186-4d5f-9f1d-4cc69abed02d req-ba3e0406-cb62-445e-8b35-8c0f53152686 service nova] Releasing lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:15:43 user nova-compute[74681]: INFO nova.compute.manager [None req-31f57080-47b3-4719-8d5e-20069aee91b2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Unrescuing
Aug 16 06:15:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-31f57080-47b3-4719-8d5e-20069aee91b2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-31f57080-47b3-4719-8d5e-20069aee91b2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquired lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:15:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-31f57080-47b3-4719-8d5e-20069aee91b2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:15:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:44 user nova-compute[74681]: DEBUG nova.network.neutron [None req-31f57080-47b3-4719-8d5e-20069aee91b2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-31f57080-47b3-4719-8d5e-20069aee91b2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Releasing lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:15:44 user nova-compute[74681]: DEBUG nova.objects.instance [None req-31f57080-47b3-4719-8d5e-20069aee91b2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'flavor' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-7551791c-b917-49c5-b880-cd1504e0a6ec req-59896c3a-fc5f-4818-bf58-aaf1a09d25fd service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7551791c-b917-49c5-b880-cd1504e0a6ec req-59896c3a-fc5f-4818-bf58-aaf1a09d25fd service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7551791c-b917-49c5-b880-cd1504e0a6ec req-59896c3a-fc5f-4818-bf58-aaf1a09d25fd service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7551791c-b917-49c5-b880-cd1504e0a6ec req-59896c3a-fc5f-4818-bf58-aaf1a09d25fd service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-7551791c-b917-49c5-b880-cd1504e0a6ec req-59896c3a-fc5f-4818-bf58-aaf1a09d25fd service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:45 user nova-compute[74681]: WARNING nova.compute.manager [req-7551791c-b917-49c5-b880-cd1504e0a6ec req-59896c3a-fc5f-4818-bf58-aaf1a09d25fd service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:15:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance destroyed successfully.
Aug 16 06:15:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-467024dc-5bf5-4c78-a954-876c6bbf8455 req-b4332547-e7f3-41f0-a302-4f59153a44f1 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-changed-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-467024dc-5bf5-4c78-a954-876c6bbf8455 req-b4332547-e7f3-41f0-a302-4f59153a44f1 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Refreshing instance network info cache due to event network-changed-cea7b68d-7124-4c01-94b1-73632f0c4000. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-467024dc-5bf5-4c78-a954-876c6bbf8455 req-b4332547-e7f3-41f0-a302-4f59153a44f1 service nova] Acquiring lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-467024dc-5bf5-4c78-a954-876c6bbf8455 req-b4332547-e7f3-41f0-a302-4f59153a44f1 service nova] Acquired lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:15:45 user nova-compute[74681]: DEBUG nova.network.neutron [req-467024dc-5bf5-4c78-a954-876c6bbf8455 req-b4332547-e7f3-41f0-a302-4f59153a44f1 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Refreshing network info cache for port cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-467024dc-5bf5-4c78-a954-876c6bbf8455 req-b4332547-e7f3-41f0-a302-4f59153a44f1 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updated VIF entry in instance network info cache for port cea7b68d-7124-4c01-94b1-73632f0c4000. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-467024dc-5bf5-4c78-a954-876c6bbf8455 req-b4332547-e7f3-41f0-a302-4f59153a44f1 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-467024dc-5bf5-4c78-a954-876c6bbf8455 req-b4332547-e7f3-41f0-a302-4f59153a44f1 service nova] Releasing lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:47 user nova-compute[74681]: WARNING nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:47 user nova-compute[74681]: WARNING nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:47 user nova-compute[74681]: WARNING nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:47 user nova-compute[74681]: WARNING nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:47 user nova-compute[74681]: WARNING nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:47 user nova-compute[74681]: WARNING nova.compute.manager [req-63d936d5-604f-4d35-b283-59a3abe5260a req-7961a47e-dba6-4414-aa42-3b797abfc614 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:15:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-1af5a8eb-dc9e-4777-9b32-cb3e01775780 req-ffe33efb-2bec-4f81-8ca7-a5dfd1a5c06a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-changed-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-1af5a8eb-dc9e-4777-9b32-cb3e01775780 req-ffe33efb-2bec-4f81-8ca7-a5dfd1a5c06a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Refreshing instance network info cache due to event network-changed-cea7b68d-7124-4c01-94b1-73632f0c4000. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:15:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1af5a8eb-dc9e-4777-9b32-cb3e01775780 req-ffe33efb-2bec-4f81-8ca7-a5dfd1a5c06a service nova] Acquiring lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:15:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1af5a8eb-dc9e-4777-9b32-cb3e01775780 req-ffe33efb-2bec-4f81-8ca7-a5dfd1a5c06a service nova] Acquired lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:15:48 user nova-compute[74681]: DEBUG nova.network.neutron [req-1af5a8eb-dc9e-4777-9b32-cb3e01775780 req-ffe33efb-2bec-4f81-8ca7-a5dfd1a5c06a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Refreshing network info cache for port cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:15:48 user nova-compute[74681]: DEBUG nova.network.neutron [req-1af5a8eb-dc9e-4777-9b32-cb3e01775780 req-ffe33efb-2bec-4f81-8ca7-a5dfd1a5c06a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updated VIF entry in instance network info cache for port cea7b68d-7124-4c01-94b1-73632f0c4000. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:15:48 user nova-compute[74681]: DEBUG nova.network.neutron [req-1af5a8eb-dc9e-4777-9b32-cb3e01775780 req-ffe33efb-2bec-4f81-8ca7-a5dfd1a5c06a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [{"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1af5a8eb-dc9e-4777-9b32-cb3e01775780 req-ffe33efb-2bec-4f81-8ca7-a5dfd1a5c06a service nova] Releasing lock "refresh_cache-d7bc97ea-3b81-488c-8c63-b83a351118d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for d7bc97ea-3b81-488c-8c63-b83a351118d2 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166549.0916991, d7bc97ea-3b81-488c-8c63-b83a351118d2 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:15:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] VM Resumed (Lifecycle Event)
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-31f57080-47b3-4719-8d5e-20069aee91b2 tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:15:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166549.095391, d7bc97ea-3b81-488c-8c63-b83a351118d2 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:15:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] VM Started (Lifecycle Event)
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-faf6820a-5788-4ed4-9e03-a32ae3ef2905 req-0d1d04a1-ce66-48ad-b605-5499f5412e2c service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-faf6820a-5788-4ed4-9e03-a32ae3ef2905 req-0d1d04a1-ce66-48ad-b605-5499f5412e2c service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-faf6820a-5788-4ed4-9e03-a32ae3ef2905 req-0d1d04a1-ce66-48ad-b605-5499f5412e2c service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-faf6820a-5788-4ed4-9e03-a32ae3ef2905 req-0d1d04a1-ce66-48ad-b605-5499f5412e2c service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-faf6820a-5788-4ed4-9e03-a32ae3ef2905 req-0d1d04a1-ce66-48ad-b605-5499f5412e2c service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:49 user nova-compute[74681]: WARNING nova.compute.manager [req-faf6820a-5788-4ed4-9e03-a32ae3ef2905 req-0d1d04a1-ce66-48ad-b605-5499f5412e2c service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state active and task_state None.
Aug 16 06:15:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166536.2625911, 3fa19b27-7628-44ce-b0ae-e1e870337855 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:15:51 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] VM Stopped (Lifecycle Event)
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-13bde1db-90a0-48b6-91f1-38bcef29781d None None] [instance: 3fa19b27-7628-44ce-b0ae-e1e870337855] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:15:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Creating image(s)
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Ensure instance console log exists: /opt/stack/data/nova/instances/e7e44f1a-d07e-4b37-bed0-9cf141649d6d/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Start _get_guest_xml network_info=[{"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '3dc316e7-771c-435a-a15c-0f7193cf446a', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7e44f1a-d07e-4b37-bed0-9cf141649d6d', 'attached_at': '', 'detached_at': '', 'volume_id': '4ce7b0de-d115-4b09-a780-a23b962bdf2d', 'serial': '4ce7b0de-d115-4b09-a780-a23b962bdf2d'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:15:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:15:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:15:51 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:15:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:15:51 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:15:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:15:51 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3656f10b-e858-46b5-9a39-afd85c95d855]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:15:51 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[334b2523-fb20-4651-9fa8-30eff0f85fa3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d] added
Aug 16 06:15:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8170df84-117d-40b1-b19d-3b0bdb4f5b9c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa6bb2d-38bb-4ccb-8657-ba9f335c33e9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHeMcTVX {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHeMcTVX" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[356a0b8d-fd55-4a12-be51-29b9e42db047]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zHeMcTVX'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2e01a1-6060-4d3e-b921-e63398a97eab]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cccab73-5cd3-4474-8d2a-df33f6a377f3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:15:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:15:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0819ba-cf70-4057-92e0-d6610c212ef9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260]
Aug 16 06:15:52 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260] successful.
Aug 16 06:15:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04edc66-f7bb-4282-9df1-ec6ed6d23a8d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84435b9-cb31-4598-a84c-6f9145e8fa90]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:15:52 user nova-compute[74681]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:15:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:15:52 user nova-compute[74681]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:15:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6516328-29c8-4ed1-81ea-a44775c58cfa]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:15:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23966393231323365', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966393231323365', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-808346252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-808346252',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZrGW8nCbzlOoz04Zj2fEVg2OyB0Rht/GlEgqvRO5/aJEfk6k8Fi2kVkXuk25bslUvg9+k0B+zN2Q16i9fyuVIwokT7VL79iIqXpmvSbcoHpdzDKcJMOcxZjGPcryb0wg==',key_name='tempest-keypair-1235458036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='824dea21de1d4cce8d70be10c5a5942b',ramdisk_id='',reservation_id='r-i4kh4yos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1593902319',owner_user_name='tempest-ServerActionsV293TestJSON-1593902319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7666caaf93494e07baf06aca64090235',uuid=e7e44f1a-d07e-4b37-bed0-9cf141649d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converting VIF {"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lazy-loading 'pci_devices' on Instance uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:15:53 user nova-compute[74681]:   <uuid>e7e44f1a-d07e-4b37-bed0-9cf141649d6d</uuid>
Aug 16 06:15:53 user nova-compute[74681]:   <name>instance-00000012</name>
Aug 16 06:15:53 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:15:53 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:15:53 user nova-compute[74681]:   <metadata>
Aug 16 06:15:53 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:15:53 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:15:53 user nova-compute[74681]:       <nova:name>tempest-ServerActionsV293TestJSON-server-808346252</nova:name>
Aug 16 06:15:53 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:15:51</nova:creationTime>
Aug 16 06:15:53 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:15:53 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:15:53 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:15:53 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:15:53 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:15:53 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:15:53 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:15:53 user nova-compute[74681]:       <nova:owner>
Aug 16 06:15:53 user nova-compute[74681]:         <nova:user uuid="7666caaf93494e07baf06aca64090235">tempest-ServerActionsV293TestJSON-1593902319-project-member</nova:user>
Aug 16 06:15:53 user nova-compute[74681]:         <nova:project uuid="824dea21de1d4cce8d70be10c5a5942b">tempest-ServerActionsV293TestJSON-1593902319</nova:project>
Aug 16 06:15:53 user nova-compute[74681]:       </nova:owner>
Aug 16 06:15:53 user nova-compute[74681]:       <nova:ports>
Aug 16 06:15:53 user nova-compute[74681]:         <nova:port uuid="7a5e5902-78fd-4339-8aa2-91c8cd2cb239">
Aug 16 06:15:53 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:15:53 user nova-compute[74681]:         </nova:port>
Aug 16 06:15:53 user nova-compute[74681]:       </nova:ports>
Aug 16 06:15:53 user nova-compute[74681]:     </nova:instance>
Aug 16 06:15:53 user nova-compute[74681]:   </metadata>
Aug 16 06:15:53 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:15:53 user nova-compute[74681]:     <system>
Aug 16 06:15:53 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:15:53 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:15:53 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:15:53 user nova-compute[74681]:       <entry name="serial">e7e44f1a-d07e-4b37-bed0-9cf141649d6d</entry>
Aug 16 06:15:53 user nova-compute[74681]:       <entry name="uuid">e7e44f1a-d07e-4b37-bed0-9cf141649d6d</entry>
Aug 16 06:15:53 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:15:53 user nova-compute[74681]:     </system>
Aug 16 06:15:53 user nova-compute[74681]:   </sysinfo>
Aug 16 06:15:53 user nova-compute[74681]:   <os>
Aug 16 06:15:53 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:15:53 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:15:53 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:15:53 user nova-compute[74681]:   </os>
Aug 16 06:15:53 user nova-compute[74681]:   <features>
Aug 16 06:15:53 user nova-compute[74681]:     <acpi/>
Aug 16 06:15:53 user nova-compute[74681]:     <apic/>
Aug 16 06:15:53 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:15:53 user nova-compute[74681]:   </features>
Aug 16 06:15:53 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:15:53 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:15:53 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:15:53 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:15:53 user nova-compute[74681]:   </clock>
Aug 16 06:15:53 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:15:53 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:15:53 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:15:53 user nova-compute[74681]:   </cpu>
Aug 16 06:15:53 user nova-compute[74681]:   <devices>
Aug 16 06:15:53 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:15:53 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:15:53 user nova-compute[74681]:       <source dev="/dev/sdb"/>
Aug 16 06:15:53 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:15:53 user nova-compute[74681]:       <serial>4ce7b0de-d115-4b09-a780-a23b962bdf2d</serial>
Aug 16 06:15:53 user nova-compute[74681]:     </disk>
Aug 16 06:15:53 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:15:53 user nova-compute[74681]:       <mac address="fa:16:3e:6a:71:f4"/>
Aug 16 06:15:53 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:15:53 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:15:53 user nova-compute[74681]:       <target dev="tap7a5e5902-78"/>
Aug 16 06:15:53 user nova-compute[74681]:     </interface>
Aug 16 06:15:53 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:15:53 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/e7e44f1a-d07e-4b37-bed0-9cf141649d6d/console.log" append="off"/>
Aug 16 06:15:53 user nova-compute[74681]:     </serial>
Aug 16 06:15:53 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:15:53 user nova-compute[74681]:     <video>
Aug 16 06:15:53 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:15:53 user nova-compute[74681]:     </video>
Aug 16 06:15:53 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:15:53 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:15:53 user nova-compute[74681]:     </rng>
Aug 16 06:15:53 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:15:53 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:15:53 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:15:53 user nova-compute[74681]:     </memballoon>
Aug 16 06:15:53 user nova-compute[74681]:   </devices>
Aug 16 06:15:53 user nova-compute[74681]: </domain>
Aug 16 06:15:53 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-808346252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-808346252',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZrGW8nCbzlOoz04Zj2fEVg2OyB0Rht/GlEgqvRO5/aJEfk6k8Fi2kVkXuk25bslUvg9+k0B+zN2Q16i9fyuVIwokT7VL79iIqXpmvSbcoHpdzDKcJMOcxZjGPcryb0wg==',key_name='tempest-keypair-1235458036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='824dea21de1d4cce8d70be10c5a5942b',ramdisk_id='',reservation_id='r-i4kh4yos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1593902319',owner_user_name='tempest-ServerActionsV293TestJSON-1593902319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:15:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7666caaf93494e07baf06aca64090235',uuid=e7e44f1a-d07e-4b37-bed0-9cf141649d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converting VIF {"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG os_vif [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a5e5902-78, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a5e5902-78, col_values=(('external_ids', {'iface-id': '7a5e5902-78fd-4339-8aa2-91c8cd2cb239', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:71:f4', 'vm-uuid': 'e7e44f1a-d07e-4b37-bed0-9cf141649d6d'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:53 user nova-compute[74681]: INFO os_vif [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78')
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] No VIF found with MAC fa:16:3e:6a:71:f4, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:15:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:15:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-a96386e3-5aba-47e1-a69d-eb14cdd1db3b req-35ea23ed-4a42-4981-bcd6-a44929681314 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a96386e3-5aba-47e1-a69d-eb14cdd1db3b req-35ea23ed-4a42-4981-bcd6-a44929681314 service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a96386e3-5aba-47e1-a69d-eb14cdd1db3b req-35ea23ed-4a42-4981-bcd6-a44929681314 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a96386e3-5aba-47e1-a69d-eb14cdd1db3b req-35ea23ed-4a42-4981-bcd6-a44929681314 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-a96386e3-5aba-47e1-a69d-eb14cdd1db3b req-35ea23ed-4a42-4981-bcd6-a44929681314 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] No waiting events found dispatching network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:55 user nova-compute[74681]: WARNING nova.compute.manager [req-a96386e3-5aba-47e1-a69d-eb14cdd1db3b req-35ea23ed-4a42-4981-bcd6-a44929681314 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received unexpected event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 for instance with vm_state building and task_state spawning.
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 02e364f9-af4e-40bb-a0b4-2b1864f54270 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 6fa74c3d-f621-4cf2-8763-6d75109fb113 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 1790612d-e3f8-4f16-8b6a-74fc37df9d25 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "90188af1-901c-453f-b113-133b1e86bc85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "90188af1-901c-453f-b113-133b1e86bc85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:15:55 user nova-compute[74681]: INFO nova.compute.claims [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Claim successful on node user
Aug 16 06:15:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:15:56 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "5e675215-481e-4a14-955a-d92d43671e1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.policy [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '830eea7441aa4c928dcb598a555e01cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6d58d07b1145b493d5a07a40c1eb0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:15:56 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Creating image(s)
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:15:56 user nova-compute[74681]: INFO nova.compute.claims [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Claim successful on node user
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk 1073741824" returned: 0 in 0.062s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.229s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Successfully created port: 470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166557.2162554, e7e44f1a-d07e-4b37-bed0-9cf141649d6d => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] VM Resumed (Lifecycle Event)
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance spawned successfully.
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166557.2239537, e7e44f1a-d07e-4b37-bed0-9cf141649d6d => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] VM Started (Lifecycle Event)
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-6241e05e-8cb3-4f3f-a03d-95ab296e7917 req-ac6a7493-0dc4-4279-8a2d-a4c530097c60 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6241e05e-8cb3-4f3f-a03d-95ab296e7917 req-ac6a7493-0dc4-4279-8a2d-a4c530097c60 service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6241e05e-8cb3-4f3f-a03d-95ab296e7917 req-ac6a7493-0dc4-4279-8a2d-a4c530097c60 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6241e05e-8cb3-4f3f-a03d-95ab296e7917 req-ac6a7493-0dc4-4279-8a2d-a4c530097c60 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-6241e05e-8cb3-4f3f-a03d-95ab296e7917 req-ac6a7493-0dc4-4279-8a2d-a4c530097c60 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] No waiting events found dispatching network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:15:57 user nova-compute[74681]: WARNING nova.compute.manager [req-6241e05e-8cb3-4f3f-a03d-95ab296e7917 req-ac6a7493-0dc4-4279-8a2d-a4c530097c60 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received unexpected event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 for instance with vm_state building and task_state spawning.
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Cannot resize image /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'migration_context' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Took 5.59 seconds to spawn the instance on the hypervisor.
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Ensure instance console log exists: /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.policy [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '830eea7441aa4c928dcb598a555e01cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6d58d07b1145b493d5a07a40c1eb0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Creating image(s)
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.compute.manager [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Took 17.32 seconds to build instance.
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1379d870-3067-437c-919a-d2af2056f608 tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.442s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.246s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:57 user nova-compute[74681]: INFO nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.261s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk 1073741824" returned: 0 in 0.054s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.234s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Cannot resize image /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.objects.instance [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'migration_context' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Ensure instance console log exists: /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Successfully created port: 9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Successfully updated port: 470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquired lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-190d64a3-7385-4a7d-ab43-dda14502f355 req-9e8d2bd7-59c7-464a-9cd2-c54116073f9a service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-changed-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-190d64a3-7385-4a7d-ab43-dda14502f355 req-9e8d2bd7-59c7-464a-9cd2-c54116073f9a service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Refreshing instance network info cache due to event network-changed-470f841a-cded-42c7-968a-0fa5ef24ea55. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-190d64a3-7385-4a7d-ab43-dda14502f355 req-9e8d2bd7-59c7-464a-9cd2-c54116073f9a service nova] Acquiring lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:15:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.network.neutron [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updating instance_info_cache with network_info: [{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Releasing lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance network_info: |[{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-190d64a3-7385-4a7d-ab43-dda14502f355 req-9e8d2bd7-59c7-464a-9cd2-c54116073f9a service nova] Acquired lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.network.neutron [req-190d64a3-7385-4a7d-ab43-dda14502f355 req-9e8d2bd7-59c7-464a-9cd2-c54116073f9a service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Refreshing network info cache for port 470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Start _get_guest_xml network_info=[{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:15:59 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:15:59 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-933932228',display_name='tempest-ServerRescueNegativeTestJSON-server-933932228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-933932228',id=19,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-kv2gn6id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:15:56Z,user_data=None,user_id='830eea7441aa4c928dcb598a555e01cd',uuid=6485c0f0-71dd-48f3-b2fe-449e1770cda7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:46:54,bridge_name='br-int',has_traffic_filtering=True,id=470f841a-cded-42c7-968a-0fa5ef24ea55,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470f841a-cd') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.objects.instance [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'pci_devices' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:15:59 user nova-compute[74681]:   <uuid>6485c0f0-71dd-48f3-b2fe-449e1770cda7</uuid>
Aug 16 06:15:59 user nova-compute[74681]:   <name>instance-00000013</name>
Aug 16 06:15:59 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:15:59 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:15:59 user nova-compute[74681]:   <metadata>
Aug 16 06:15:59 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:15:59 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:15:59 user nova-compute[74681]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-933932228</nova:name>
Aug 16 06:15:59 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:15:59</nova:creationTime>
Aug 16 06:15:59 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:15:59 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:15:59 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:15:59 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:15:59 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:15:59 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:15:59 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:15:59 user nova-compute[74681]:       <nova:owner>
Aug 16 06:15:59 user nova-compute[74681]:         <nova:user uuid="830eea7441aa4c928dcb598a555e01cd">tempest-ServerRescueNegativeTestJSON-472247401-project-member</nova:user>
Aug 16 06:15:59 user nova-compute[74681]:         <nova:project uuid="ce6d58d07b1145b493d5a07a40c1eb0c">tempest-ServerRescueNegativeTestJSON-472247401</nova:project>
Aug 16 06:15:59 user nova-compute[74681]:       </nova:owner>
Aug 16 06:15:59 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:15:59 user nova-compute[74681]:       <nova:ports>
Aug 16 06:15:59 user nova-compute[74681]:         <nova:port uuid="470f841a-cded-42c7-968a-0fa5ef24ea55">
Aug 16 06:15:59 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 06:15:59 user nova-compute[74681]:         </nova:port>
Aug 16 06:15:59 user nova-compute[74681]:       </nova:ports>
Aug 16 06:15:59 user nova-compute[74681]:     </nova:instance>
Aug 16 06:15:59 user nova-compute[74681]:   </metadata>
Aug 16 06:15:59 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:15:59 user nova-compute[74681]:     <system>
Aug 16 06:15:59 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:15:59 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:15:59 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:15:59 user nova-compute[74681]:       <entry name="serial">6485c0f0-71dd-48f3-b2fe-449e1770cda7</entry>
Aug 16 06:15:59 user nova-compute[74681]:       <entry name="uuid">6485c0f0-71dd-48f3-b2fe-449e1770cda7</entry>
Aug 16 06:15:59 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:15:59 user nova-compute[74681]:     </system>
Aug 16 06:15:59 user nova-compute[74681]:   </sysinfo>
Aug 16 06:15:59 user nova-compute[74681]:   <os>
Aug 16 06:15:59 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:15:59 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:15:59 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:15:59 user nova-compute[74681]:   </os>
Aug 16 06:15:59 user nova-compute[74681]:   <features>
Aug 16 06:15:59 user nova-compute[74681]:     <acpi/>
Aug 16 06:15:59 user nova-compute[74681]:     <apic/>
Aug 16 06:15:59 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:15:59 user nova-compute[74681]:   </features>
Aug 16 06:15:59 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:15:59 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:15:59 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:15:59 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:15:59 user nova-compute[74681]:   </clock>
Aug 16 06:15:59 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:15:59 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:15:59 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:15:59 user nova-compute[74681]:   </cpu>
Aug 16 06:15:59 user nova-compute[74681]:   <devices>
Aug 16 06:15:59 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:15:59 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:15:59 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk"/>
Aug 16 06:15:59 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:15:59 user nova-compute[74681]:     </disk>
Aug 16 06:15:59 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:15:59 user nova-compute[74681]:       <mac address="fa:16:3e:ec:46:54"/>
Aug 16 06:15:59 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:15:59 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:15:59 user nova-compute[74681]:       <target dev="tap470f841a-cd"/>
Aug 16 06:15:59 user nova-compute[74681]:     </interface>
Aug 16 06:15:59 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:15:59 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/console.log" append="off"/>
Aug 16 06:15:59 user nova-compute[74681]:     </serial>
Aug 16 06:15:59 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:15:59 user nova-compute[74681]:     <video>
Aug 16 06:15:59 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:15:59 user nova-compute[74681]:     </video>
Aug 16 06:15:59 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:15:59 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:15:59 user nova-compute[74681]:     </rng>
Aug 16 06:15:59 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:15:59 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:15:59 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:15:59 user nova-compute[74681]:     </memballoon>
Aug 16 06:15:59 user nova-compute[74681]:   </devices>
Aug 16 06:15:59 user nova-compute[74681]: </domain>
Aug 16 06:15:59 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-933932228',display_name='tempest-ServerRescueNegativeTestJSON-server-933932228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-933932228',id=19,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-kv2gn6id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:15:56Z,user_data=None,user_id='830eea7441aa4c928dcb598a555e01cd',uuid=6485c0f0-71dd-48f3-b2fe-449e1770cda7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:46:54,bridge_name='br-int',has_traffic_filtering=True,id=470f841a-cded-42c7-968a-0fa5ef24ea55,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470f841a-cd') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG os_vif [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:46:54,bridge_name='br-int',has_traffic_filtering=True,id=470f841a-cded-42c7-968a-0fa5ef24ea55,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470f841a-cd') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap470f841a-cd, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap470f841a-cd, col_values=(('external_ids', {'iface-id': '470f841a-cded-42c7-968a-0fa5ef24ea55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:46:54', 'vm-uuid': '6485c0f0-71dd-48f3-b2fe-449e1770cda7'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:15:59 user nova-compute[74681]: INFO os_vif [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:46:54,bridge_name='br-int',has_traffic_filtering=True,id=470f841a-cded-42c7-968a-0fa5ef24ea55,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470f841a-cd')
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:15:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No VIF found with MAC fa:16:3e:ec:46:54, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Successfully updated port: 9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquired lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.network.neutron [req-190d64a3-7385-4a7d-ab43-dda14502f355 req-9e8d2bd7-59c7-464a-9cd2-c54116073f9a service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updated VIF entry in instance network info cache for port 470f841a-cded-42c7-968a-0fa5ef24ea55. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.network.neutron [req-190d64a3-7385-4a7d-ab43-dda14502f355 req-9e8d2bd7-59c7-464a-9cd2-c54116073f9a service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updating instance_info_cache with network_info: [{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-190d64a3-7385-4a7d-ab43-dda14502f355 req-9e8d2bd7-59c7-464a-9cd2-c54116073f9a service nova] Releasing lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-d44d7d75-16b2-4ab2-8c50-b715aba538ad req-f830c50c-aa0e-4cc5-94b3-e05e4f4cbc3c service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-changed-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-d44d7d75-16b2-4ab2-8c50-b715aba538ad req-f830c50c-aa0e-4cc5-94b3-e05e4f4cbc3c service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Refreshing instance network info cache due to event network-changed-9cebfa23-8934-4e08-9cf9-ac02c7f663b7. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d44d7d75-16b2-4ab2-8c50-b715aba538ad req-f830c50c-aa0e-4cc5-94b3-e05e4f4cbc3c service nova] Acquiring lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updating instance_info_cache with network_info: [{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Releasing lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Instance network_info: |[{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d44d7d75-16b2-4ab2-8c50-b715aba538ad req-f830c50c-aa0e-4cc5-94b3-e05e4f4cbc3c service nova] Acquired lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.network.neutron [req-d44d7d75-16b2-4ab2-8c50-b715aba538ad req-f830c50c-aa0e-4cc5-94b3-e05e4f4cbc3c service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Refreshing network info cache for port 9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Start _get_guest_xml network_info=[{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:16:00 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:16:00 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:16:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1319824773',display_name='tempest-ServerRescueNegativeTestJSON-server-1319824773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1319824773',id=20,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-webr75hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:15:57Z,user_data=None,user_id='830eea7441aa4c928dcb598a555e01cd',uuid=5e675215-481e-4a14-955a-d92d43671e1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9cebfa23-8934-4e08-9cf9-ac02c7f663b7,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cebfa23-89') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.objects.instance [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:16:01 user nova-compute[74681]:   <uuid>5e675215-481e-4a14-955a-d92d43671e1a</uuid>
Aug 16 06:16:01 user nova-compute[74681]:   <name>instance-00000014</name>
Aug 16 06:16:01 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:16:01 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:16:01 user nova-compute[74681]:   <metadata>
Aug 16 06:16:01 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:16:01 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:16:01 user nova-compute[74681]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1319824773</nova:name>
Aug 16 06:16:01 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:16:00</nova:creationTime>
Aug 16 06:16:01 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:16:01 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:16:01 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:16:01 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:16:01 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:16:01 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:16:01 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:16:01 user nova-compute[74681]:       <nova:owner>
Aug 16 06:16:01 user nova-compute[74681]:         <nova:user uuid="830eea7441aa4c928dcb598a555e01cd">tempest-ServerRescueNegativeTestJSON-472247401-project-member</nova:user>
Aug 16 06:16:01 user nova-compute[74681]:         <nova:project uuid="ce6d58d07b1145b493d5a07a40c1eb0c">tempest-ServerRescueNegativeTestJSON-472247401</nova:project>
Aug 16 06:16:01 user nova-compute[74681]:       </nova:owner>
Aug 16 06:16:01 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:16:01 user nova-compute[74681]:       <nova:ports>
Aug 16 06:16:01 user nova-compute[74681]:         <nova:port uuid="9cebfa23-8934-4e08-9cf9-ac02c7f663b7">
Aug 16 06:16:01 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 06:16:01 user nova-compute[74681]:         </nova:port>
Aug 16 06:16:01 user nova-compute[74681]:       </nova:ports>
Aug 16 06:16:01 user nova-compute[74681]:     </nova:instance>
Aug 16 06:16:01 user nova-compute[74681]:   </metadata>
Aug 16 06:16:01 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:16:01 user nova-compute[74681]:     <system>
Aug 16 06:16:01 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:16:01 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:16:01 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:16:01 user nova-compute[74681]:       <entry name="serial">5e675215-481e-4a14-955a-d92d43671e1a</entry>
Aug 16 06:16:01 user nova-compute[74681]:       <entry name="uuid">5e675215-481e-4a14-955a-d92d43671e1a</entry>
Aug 16 06:16:01 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:16:01 user nova-compute[74681]:     </system>
Aug 16 06:16:01 user nova-compute[74681]:   </sysinfo>
Aug 16 06:16:01 user nova-compute[74681]:   <os>
Aug 16 06:16:01 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:16:01 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:16:01 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:16:01 user nova-compute[74681]:   </os>
Aug 16 06:16:01 user nova-compute[74681]:   <features>
Aug 16 06:16:01 user nova-compute[74681]:     <acpi/>
Aug 16 06:16:01 user nova-compute[74681]:     <apic/>
Aug 16 06:16:01 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:16:01 user nova-compute[74681]:   </features>
Aug 16 06:16:01 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:16:01 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:16:01 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:16:01 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:16:01 user nova-compute[74681]:   </clock>
Aug 16 06:16:01 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:16:01 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:16:01 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:16:01 user nova-compute[74681]:   </cpu>
Aug 16 06:16:01 user nova-compute[74681]:   <devices>
Aug 16 06:16:01 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:16:01 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:16:01 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk"/>
Aug 16 06:16:01 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:16:01 user nova-compute[74681]:     </disk>
Aug 16 06:16:01 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:16:01 user nova-compute[74681]:       <mac address="fa:16:3e:6a:9b:eb"/>
Aug 16 06:16:01 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:16:01 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:16:01 user nova-compute[74681]:       <target dev="tap9cebfa23-89"/>
Aug 16 06:16:01 user nova-compute[74681]:     </interface>
Aug 16 06:16:01 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:16:01 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/console.log" append="off"/>
Aug 16 06:16:01 user nova-compute[74681]:     </serial>
Aug 16 06:16:01 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:16:01 user nova-compute[74681]:     <video>
Aug 16 06:16:01 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:16:01 user nova-compute[74681]:     </video>
Aug 16 06:16:01 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:16:01 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:16:01 user nova-compute[74681]:     </rng>
Aug 16 06:16:01 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:16:01 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:16:01 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:16:01 user nova-compute[74681]:     </memballoon>
Aug 16 06:16:01 user nova-compute[74681]:   </devices>
Aug 16 06:16:01 user nova-compute[74681]: </domain>
Aug 16 06:16:01 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1319824773',display_name='tempest-ServerRescueNegativeTestJSON-server-1319824773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1319824773',id=20,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-webr75hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:15:57Z,user_data=None,user_id='830eea7441aa4c928dcb598a555e01cd',uuid=5e675215-481e-4a14-955a-d92d43671e1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9cebfa23-8934-4e08-9cf9-ac02c7f663b7,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cebfa23-89') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG os_vif [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9cebfa23-8934-4e08-9cf9-ac02c7f663b7,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cebfa23-89') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cebfa23-89, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cebfa23-89, col_values=(('external_ids', {'iface-id': '9cebfa23-8934-4e08-9cf9-ac02c7f663b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:9b:eb', 'vm-uuid': '5e675215-481e-4a14-955a-d92d43671e1a'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:01 user nova-compute[74681]: INFO os_vif [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:9b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9cebfa23-8934-4e08-9cf9-ac02c7f663b7,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cebfa23-89')
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No VIF found with MAC fa:16:3e:6a:9b:eb, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.network.neutron [req-d44d7d75-16b2-4ab2-8c50-b715aba538ad req-f830c50c-aa0e-4cc5-94b3-e05e4f4cbc3c service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updated VIF entry in instance network info cache for port 9cebfa23-8934-4e08-9cf9-ac02c7f663b7. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.network.neutron [req-d44d7d75-16b2-4ab2-8c50-b715aba538ad req-f830c50c-aa0e-4cc5-94b3-e05e4f4cbc3c service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updating instance_info_cache with network_info: [{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d44d7d75-16b2-4ab2-8c50-b715aba538ad req-f830c50c-aa0e-4cc5-94b3-e05e4f4cbc3c service nova] Releasing lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-a3f63b67-4c58-49a5-b472-62ca47f9da9d req-b6b005a0-adb8-47a9-809a-a37a8834952f service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3f63b67-4c58-49a5-b472-62ca47f9da9d req-b6b005a0-adb8-47a9-809a-a37a8834952f service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3f63b67-4c58-49a5-b472-62ca47f9da9d req-b6b005a0-adb8-47a9-809a-a37a8834952f service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3f63b67-4c58-49a5-b472-62ca47f9da9d req-b6b005a0-adb8-47a9-809a-a37a8834952f service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-a3f63b67-4c58-49a5-b472-62ca47f9da9d req-b6b005a0-adb8-47a9-809a-a37a8834952f service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:01 user nova-compute[74681]: WARNING nova.compute.manager [req-a3f63b67-4c58-49a5-b472-62ca47f9da9d req-b6b005a0-adb8-47a9-809a-a37a8834952f service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state building and task_state spawning.
Aug 16 06:16:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:03 user nova-compute[74681]: WARNING nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state building and task_state spawning.
Aug 16 06:16:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] No waiting events found dispatching network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:03 user nova-compute[74681]: WARNING nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received unexpected event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 for instance with vm_state building and task_state spawning.
Aug 16 06:16:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:04 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] No waiting events found dispatching network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:04 user nova-compute[74681]: WARNING nova.compute.manager [req-2ee59ecc-7615-4f89-bc91-f0216fa2b201 req-6efce2ea-998f-41a9-91f4-c958d5ad5f2d service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received unexpected event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 for instance with vm_state building and task_state spawning.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166565.2139397, 6485c0f0-71dd-48f3-b2fe-449e1770cda7 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] VM Resumed (Lifecycle Event)
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance spawned successfully.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166565.218702, 6485c0f0-71dd-48f3-b2fe-449e1770cda7 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] VM Started (Lifecycle Event)
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Took 8.90 seconds to spawn the instance on the hypervisor.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Took 9.73 seconds to build instance.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-30218692-083c-4874-b5a8-f29be1ac1793 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.843s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166565.6643336, 5e675215-481e-4a14-955a-d92d43671e1a => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] VM Resumed (Lifecycle Event)
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Instance spawned successfully.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166565.6653662, 5e675215-481e-4a14-955a-d92d43671e1a => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] VM Started (Lifecycle Event)
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Took 8.40 seconds to spawn the instance on the hypervisor.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:05 user nova-compute[74681]: INFO nova.compute.manager [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Took 9.53 seconds to build instance.
Aug 16 06:16:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-298be948-1f87-4369-8b22-d597bb5934b8 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "5e675215-481e-4a14-955a-d92d43671e1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.645s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:17 user nova-compute[74681]: INFO nova.compute.manager [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Detaching volume fa0fc499-46b6-44aa-aa5a-76069df747f8
Aug 16 06:16:17 user nova-compute[74681]: INFO nova.virt.block_device [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Attempting to driver detach volume fa0fc499-46b6-44aa-aa5a-76069df747f8 from mountpoint /dev/vdb
Aug 16 06:16:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Attempting to detach device vdb from instance d7bc97ea-3b81-488c-8c63-b83a351118d2 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:16:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:16:17 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:16:17 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:16:17 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:16:17 user nova-compute[74681]:   <serial>fa0fc499-46b6-44aa-aa5a-76069df747f8</serial>
Aug 16 06:16:17 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:16:17 user nova-compute[74681]: </disk>
Aug 16 06:16:17 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:16:17 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Successfully detached device vdb from instance d7bc97ea-3b81-488c-8c63-b83a351118d2 from the persistent domain config.
Aug 16 06:16:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7bc97ea-3b81-488c-8c63-b83a351118d2 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:16:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:16:17 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:16:17 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:16:17 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:16:17 user nova-compute[74681]:   <serial>fa0fc499-46b6-44aa-aa5a-76069df747f8</serial>
Aug 16 06:16:17 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:16:17 user nova-compute[74681]: </disk>
Aug 16 06:16:17 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166578.4188733, d7bc97ea-3b81-488c-8c63-b83a351118d2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:16:18 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Successfully detached device vdb from instance d7bc97ea-3b81-488c-8c63-b83a351118d2 from the live domain config.
Aug 16 06:16:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pklLIHiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:16:18 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8412e4-5c83-4911-b2e8-cbdf14a66a6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b2d30d-9b93-46cd-8f08-f39767277065]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:16:18 user nova-compute[74681]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:16:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 (non-flash)
Aug 16 06:16:18 user nova-compute[74681]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:16:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9484187f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8'): ({'sdf'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Removing single pathed devices sdf {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9847eedf-2caa-48ca-8631-2c22668fc8b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1926be39-5612-45f1-b6a9-9bdf1823d158]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Flushing IO for device /dev/sdf {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e9afef-2488-49b3-ad19-3641a152d9eb]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d70853-bec6-4e01-9981-27e8aa07c97f]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33df4cf-ec24-4ece-b932-643d823be25a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[702697b1-caea-49a3-8742-ea963bd2598e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8, portal: 172.16.0.220,3260]
Aug 16 06:16:18 user nova-compute[74681]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8, portal: 172.16.0.220,3260] successful.
Aug 16 06:16:18 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa0fc499-46b6-44aa-aa5a-76069df747f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b7e47-224e-487e-90fb-3efae7e743aa]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] <== disconnect_volume: return (351ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:16:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:16:19 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'flavor' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba1c7b7b-62f6-49a7-aa29-8ddde1e9da4f tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.053s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:25 user nova-compute[74681]: INFO nova.compute.manager [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Terminating instance
Aug 16 06:16:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-98ce60ef-685e-4429-9645-c173f5bac66f req-914519a0-11b1-460c-8bce-e312abbcb4ad service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received event network-vif-unplugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-98ce60ef-685e-4429-9645-c173f5bac66f req-914519a0-11b1-460c-8bce-e312abbcb4ad service nova] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-98ce60ef-685e-4429-9645-c173f5bac66f req-914519a0-11b1-460c-8bce-e312abbcb4ad service nova] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-98ce60ef-685e-4429-9645-c173f5bac66f req-914519a0-11b1-460c-8bce-e312abbcb4ad service nova] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-98ce60ef-685e-4429-9645-c173f5bac66f req-914519a0-11b1-460c-8bce-e312abbcb4ad service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] No waiting events found dispatching network-vif-unplugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-98ce60ef-685e-4429-9645-c173f5bac66f req-914519a0-11b1-460c-8bce-e312abbcb4ad service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received event network-vif-unplugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:16:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Instance destroyed successfully.
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.objects.instance [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lazy-loading 'resources' on Instance uuid 6fa74c3d-f621-4cf2-8763-6d75109fb113 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-483510836',display_name='tempest-VolumesAdminNegativeTest-server-483510836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-483510836',id=6,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWKHYeWD7ESUmPMiUorXCULKHUwW1JFLpVh0ViOl9d1WOcz4V34a47c7LhRxvoi37qq0PVTiQkBzfAxI1PkZmMcBbqLpt/q9JP4r8UGlFJDbt6214Fk7aq3tAzhaK/Adw==',key_name='tempest-keypair-1459112770',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c36ac064a14486eb8673f39338119db',ramdisk_id='',reservation_id='r-9dy2umhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-128005769',owner_user_name='tempest-VolumesAdminNegativeTest-128005769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d15ba1a73e62426c97713c02fd1c31fb',uuid=6fa74c3d-f621-4cf2-8763-6d75109fb113,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converting VIF {"id": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "address": "fa:16:3e:f2:7a:64", "network": {"id": "cdb277c1-b071-4925-8a58-8fbd61b6571b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-325208848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c36ac064a14486eb8673f39338119db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ca2fee-70", "ovs_interfaceid": "48ca2fee-705e-4726-8b71-1ddd30f158d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:7a:64,bridge_name='br-int',has_traffic_filtering=True,id=48ca2fee-705e-4726-8b71-1ddd30f158d4,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ca2fee-70') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG os_vif [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:7a:64,bridge_name='br-int',has_traffic_filtering=True,id=48ca2fee-705e-4726-8b71-1ddd30f158d4,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ca2fee-70') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48ca2fee-70, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:16:26 user nova-compute[74681]: INFO os_vif [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:7a:64,bridge_name='br-int',has_traffic_filtering=True,id=48ca2fee-705e-4726-8b71-1ddd30f158d4,network=Network(cdb277c1-b071-4925-8a58-8fbd61b6571b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ca2fee-70')
Aug 16 06:16:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Deleting instance files /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113_del
Aug 16 06:16:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Deletion of /opt/stack/data/nova/instances/6fa74c3d-f621-4cf2-8763-6d75109fb113_del complete
Aug 16 06:16:26 user nova-compute[74681]: INFO nova.compute.manager [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 06:16:26 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:16:26 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-4e3eb87b-0c96-4c85-ac90-02cc08f9ebbf req-92a86306-5301-4223-b4c8-c6e137c7b944 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received event network-vif-deleted-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:28 user nova-compute[74681]: INFO nova.compute.manager [req-4e3eb87b-0c96-4c85-ac90-02cc08f9ebbf req-92a86306-5301-4223-b4c8-c6e137c7b944 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Neutron deleted interface 48ca2fee-705e-4726-8b71-1ddd30f158d4; detaching it from the instance and deleting it from the info cache
Aug 16 06:16:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-4e3eb87b-0c96-4c85-ac90-02cc08f9ebbf req-92a86306-5301-4223-b4c8-c6e137c7b944 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:28 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Took 1.28 seconds to deallocate network for instance.
Aug 16 06:16:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-4e3eb87b-0c96-4c85-ac90-02cc08f9ebbf req-92a86306-5301-4223-b4c8-c6e137c7b944 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Detach interface failed, port_id=48ca2fee-705e-4726-8b71-1ddd30f158d4, reason: Instance 6fa74c3d-f621-4cf2-8763-6d75109fb113 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-de0379db-a63f-4795-9f0c-b266cb6f132a req-c7620f61-5b98-45fa-a10e-0ed330b03586 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received event network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-de0379db-a63f-4795-9f0c-b266cb6f132a req-c7620f61-5b98-45fa-a10e-0ed330b03586 service nova] Acquiring lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-de0379db-a63f-4795-9f0c-b266cb6f132a req-c7620f61-5b98-45fa-a10e-0ed330b03586 service nova] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-de0379db-a63f-4795-9f0c-b266cb6f132a req-c7620f61-5b98-45fa-a10e-0ed330b03586 service nova] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-de0379db-a63f-4795-9f0c-b266cb6f132a req-c7620f61-5b98-45fa-a10e-0ed330b03586 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] No waiting events found dispatching network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:28 user nova-compute[74681]: WARNING nova.compute.manager [req-de0379db-a63f-4795-9f0c-b266cb6f132a req-c7620f61-5b98-45fa-a10e-0ed330b03586 service nova] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Received unexpected event network-vif-plugged-48ca2fee-705e-4726-8b71-1ddd30f158d4 for instance with vm_state deleted and task_state None.
Aug 16 06:16:28 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:16:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:28 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Deleted allocations for instance 6fa74c3d-f621-4cf2-8763-6d75109fb113
Aug 16 06:16:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-be469d6c-4624-4c7d-86fc-f9022d614f16 tempest-VolumesAdminNegativeTest-128005769 tempest-VolumesAdminNegativeTest-128005769-project-member] Lock "6fa74c3d-f621-4cf2-8763-6d75109fb113" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.769s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:29 user nova-compute[74681]: INFO nova.compute.manager [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Terminating instance
Aug 16 06:16:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:16:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Instance destroyed successfully.
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'resources' on Instance uuid 90188af1-901c-453f-b113-133b1e86bc85 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:09:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1357676255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1357676255',id=5,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPP4WdnC3IitpPuXRh9DuNwOaenN+tFxMoPwQ4Jrt+KrAEDKAfk0EqNOL7twax4UQxFQ8J959+AlJCZYRuXMxHriC3b+6QPfAM5Prrzgi7p+Y1iarKTje/zmsuBCucm7aQ==',key_name='tempest-keypair-1915031990',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-uaxulgsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=90188af1-901c-453f-b113-133b1e86bc85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "address": "fa:16:3e:df:86:ff", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0bdeea-d3", "ovs_interfaceid": "ca0bdeea-d3c9-4993-b9ee-a51a9dd66482", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG os_vif [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca0bdeea-d3, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:30 user nova-compute[74681]: INFO os_vif [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:86:ff,bridge_name='br-int',has_traffic_filtering=True,id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0bdeea-d3')
Aug 16 06:16:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Deleting instance files /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85_del
Aug 16 06:16:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Deletion of /opt/stack/data/nova/instances/90188af1-901c-453f-b113-133b1e86bc85_del complete
Aug 16 06:16:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:30 user nova-compute[74681]: INFO nova.compute.manager [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 06:16:30 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-c9ea7f6d-54b3-41f4-a532-68df83458fee req-545250fc-d04d-43ab-9546-156898ba701d service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-unplugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c9ea7f6d-54b3-41f4-a532-68df83458fee req-545250fc-d04d-43ab-9546-156898ba701d service nova] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c9ea7f6d-54b3-41f4-a532-68df83458fee req-545250fc-d04d-43ab-9546-156898ba701d service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c9ea7f6d-54b3-41f4-a532-68df83458fee req-545250fc-d04d-43ab-9546-156898ba701d service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-c9ea7f6d-54b3-41f4-a532-68df83458fee req-545250fc-d04d-43ab-9546-156898ba701d service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] No waiting events found dispatching network-vif-unplugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-c9ea7f6d-54b3-41f4-a532-68df83458fee req-545250fc-d04d-43ab-9546-156898ba701d service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-unplugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:16:30 user nova-compute[74681]: INFO nova.compute.claims [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Claim successful on node user
Aug 16 06:16:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:16:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:16:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Creating image(s)
Aug 16 06:16:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "/opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "/opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "/opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:31 user nova-compute[74681]: DEBUG nova.policy [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de61ce701f0b41fdb80225fc0ff05fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c0bd15a5644f4f92453e4706aef46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.598s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-e6573fa0-f147-44bb-beca-d2b3a5bb7170 req-73ff079b-17ed-4522-a45b-04c5691ff2df service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-deleted-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:32 user nova-compute[74681]: INFO nova.compute.manager [req-e6573fa0-f147-44bb-beca-d2b3a5bb7170 req-73ff079b-17ed-4522-a45b-04c5691ff2df service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Neutron deleted interface ca0bdeea-d3c9-4993-b9ee-a51a9dd66482; detaching it from the instance and deleting it from the info cache
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-e6573fa0-f147-44bb-beca-d2b3a5bb7170 req-73ff079b-17ed-4522-a45b-04c5691ff2df service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.254s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:32 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Took 1.81 seconds to deallocate network for instance.
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk 1073741824" returned: 0 in 0.076s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-e6573fa0-f147-44bb-beca-d2b3a5bb7170 req-73ff079b-17ed-4522-a45b-04c5691ff2df service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Detach interface failed, port_id=ca0bdeea-d3c9-4993-b9ee-a51a9dd66482, reason: Instance 90188af1-901c-453f-b113-133b1e86bc85 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.234s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-6bfba273-4ac5-426a-922f-bf0b22bc928a req-8e8d17d0-d4d1-4257-b4cd-86838f821915 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6bfba273-4ac5-426a-922f-bf0b22bc928a req-8e8d17d0-d4d1-4257-b4cd-86838f821915 service nova] Acquiring lock "90188af1-901c-453f-b113-133b1e86bc85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6bfba273-4ac5-426a-922f-bf0b22bc928a req-8e8d17d0-d4d1-4257-b4cd-86838f821915 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6bfba273-4ac5-426a-922f-bf0b22bc928a req-8e8d17d0-d4d1-4257-b4cd-86838f821915 service nova] Lock "90188af1-901c-453f-b113-133b1e86bc85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-6bfba273-4ac5-426a-922f-bf0b22bc928a req-8e8d17d0-d4d1-4257-b4cd-86838f821915 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] No waiting events found dispatching network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:32 user nova-compute[74681]: WARNING nova.compute.manager [req-6bfba273-4ac5-426a-922f-bf0b22bc928a req-8e8d17d0-d4d1-4257-b4cd-86838f821915 service nova] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Received unexpected event network-vif-plugged-ca0bdeea-d3c9-4993-b9ee-a51a9dd66482 for instance with vm_state deleted and task_state None.
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.network.neutron [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Successfully created port: 708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Cannot resize image /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'migration_context' on Instance uuid 84979ec3-09d4-4463-a20b-ca5dcf6986de {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Ensure instance console log exists: /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:32 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Deleted allocations for instance 90188af1-901c-453f-b113-133b1e86bc85
Aug 16 06:16:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-697949cc-3ab7-49d0-b529-b15e7af76d43 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "90188af1-901c-453f-b113-133b1e86bc85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.560s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Successfully updated port: 708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:16:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:16:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquired lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:16:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-8ce129d5-3d57-4b9f-a9b7-8768b1d27b4f req-0a2fda0a-d305-4e7c-92ce-498143511e7a service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received event network-changed-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-8ce129d5-3d57-4b9f-a9b7-8768b1d27b4f req-0a2fda0a-d305-4e7c-92ce-498143511e7a service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Refreshing instance network info cache due to event network-changed-708a7b8d-8aee-4623-9ce7-fc3026329b9a. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ce129d5-3d57-4b9f-a9b7-8768b1d27b4f req-0a2fda0a-d305-4e7c-92ce-498143511e7a service nova] Acquiring lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Updating instance_info_cache with network_info: [{"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Releasing lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Instance network_info: |[{"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ce129d5-3d57-4b9f-a9b7-8768b1d27b4f req-0a2fda0a-d305-4e7c-92ce-498143511e7a service nova] Acquired lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-8ce129d5-3d57-4b9f-a9b7-8768b1d27b4f req-0a2fda0a-d305-4e7c-92ce-498143511e7a service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Refreshing network info cache for port 708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Start _get_guest_xml network_info=[{"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:16:34 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:16:34 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-786394704',display_name='tempest-AttachVolumeNegativeTest-server-786394704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-786394704',id=21,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwW0ziruig+Bf1GRbamUDusIQjSr2dZuojMJCgEWR1XNJjztmIgBfYNw1HBNm8O8zI0b1YaYVD1/CurIejhbrkN7tsGxH5QCMtsa2IpugHpiOljqv2jXP0SDYT6pRQ0yg==',key_name='tempest-keypair-1851072068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-4h2nl7v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=84979ec3-09d4-4463-a20b-ca5dcf6986de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:20:f7,bridge_name='br-int',has_traffic_filtering=True,id=708a7b8d-8aee-4623-9ce7-fc3026329b9a,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708a7b8d-8a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.objects.instance [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'pci_devices' on Instance uuid 84979ec3-09d4-4463-a20b-ca5dcf6986de {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:16:34 user nova-compute[74681]:   <uuid>84979ec3-09d4-4463-a20b-ca5dcf6986de</uuid>
Aug 16 06:16:34 user nova-compute[74681]:   <name>instance-00000015</name>
Aug 16 06:16:34 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:16:34 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:16:34 user nova-compute[74681]:   <metadata>
Aug 16 06:16:34 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:16:34 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:16:34 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeNegativeTest-server-786394704</nova:name>
Aug 16 06:16:34 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:16:34</nova:creationTime>
Aug 16 06:16:34 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:16:34 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:16:34 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:16:34 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:16:34 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:16:34 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:16:34 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:16:34 user nova-compute[74681]:       <nova:owner>
Aug 16 06:16:34 user nova-compute[74681]:         <nova:user uuid="de61ce701f0b41fdb80225fc0ff05fac">tempest-AttachVolumeNegativeTest-1322537387-project-member</nova:user>
Aug 16 06:16:34 user nova-compute[74681]:         <nova:project uuid="74c0bd15a5644f4f92453e4706aef46d">tempest-AttachVolumeNegativeTest-1322537387</nova:project>
Aug 16 06:16:34 user nova-compute[74681]:       </nova:owner>
Aug 16 06:16:34 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:16:34 user nova-compute[74681]:       <nova:ports>
Aug 16 06:16:34 user nova-compute[74681]:         <nova:port uuid="708a7b8d-8aee-4623-9ce7-fc3026329b9a">
Aug 16 06:16:34 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:16:34 user nova-compute[74681]:         </nova:port>
Aug 16 06:16:34 user nova-compute[74681]:       </nova:ports>
Aug 16 06:16:34 user nova-compute[74681]:     </nova:instance>
Aug 16 06:16:34 user nova-compute[74681]:   </metadata>
Aug 16 06:16:34 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:16:34 user nova-compute[74681]:     <system>
Aug 16 06:16:34 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:16:34 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:16:34 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:16:34 user nova-compute[74681]:       <entry name="serial">84979ec3-09d4-4463-a20b-ca5dcf6986de</entry>
Aug 16 06:16:34 user nova-compute[74681]:       <entry name="uuid">84979ec3-09d4-4463-a20b-ca5dcf6986de</entry>
Aug 16 06:16:34 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:16:34 user nova-compute[74681]:     </system>
Aug 16 06:16:34 user nova-compute[74681]:   </sysinfo>
Aug 16 06:16:34 user nova-compute[74681]:   <os>
Aug 16 06:16:34 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:16:34 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:16:34 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:16:34 user nova-compute[74681]:   </os>
Aug 16 06:16:34 user nova-compute[74681]:   <features>
Aug 16 06:16:34 user nova-compute[74681]:     <acpi/>
Aug 16 06:16:34 user nova-compute[74681]:     <apic/>
Aug 16 06:16:34 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:16:34 user nova-compute[74681]:   </features>
Aug 16 06:16:34 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:16:34 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:16:34 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:16:34 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:16:34 user nova-compute[74681]:   </clock>
Aug 16 06:16:34 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:16:34 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:16:34 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:16:34 user nova-compute[74681]:   </cpu>
Aug 16 06:16:34 user nova-compute[74681]:   <devices>
Aug 16 06:16:34 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:16:34 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:16:34 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk"/>
Aug 16 06:16:34 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:16:34 user nova-compute[74681]:     </disk>
Aug 16 06:16:34 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:16:34 user nova-compute[74681]:       <mac address="fa:16:3e:7b:20:f7"/>
Aug 16 06:16:34 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:16:34 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:16:34 user nova-compute[74681]:       <target dev="tap708a7b8d-8a"/>
Aug 16 06:16:34 user nova-compute[74681]:     </interface>
Aug 16 06:16:34 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:16:34 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/console.log" append="off"/>
Aug 16 06:16:34 user nova-compute[74681]:     </serial>
Aug 16 06:16:34 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:16:34 user nova-compute[74681]:     <video>
Aug 16 06:16:34 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:16:34 user nova-compute[74681]:     </video>
Aug 16 06:16:34 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:16:34 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:16:34 user nova-compute[74681]:     </rng>
Aug 16 06:16:34 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:16:34 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:16:34 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:16:34 user nova-compute[74681]:     </memballoon>
Aug 16 06:16:34 user nova-compute[74681]:   </devices>
Aug 16 06:16:34 user nova-compute[74681]: </domain>
Aug 16 06:16:34 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-786394704',display_name='tempest-AttachVolumeNegativeTest-server-786394704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-786394704',id=21,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwW0ziruig+Bf1GRbamUDusIQjSr2dZuojMJCgEWR1XNJjztmIgBfYNw1HBNm8O8zI0b1YaYVD1/CurIejhbrkN7tsGxH5QCMtsa2IpugHpiOljqv2jXP0SDYT6pRQ0yg==',key_name='tempest-keypair-1851072068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-4h2nl7v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=84979ec3-09d4-4463-a20b-ca5dcf6986de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:20:f7,bridge_name='br-int',has_traffic_filtering=True,id=708a7b8d-8aee-4623-9ce7-fc3026329b9a,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708a7b8d-8a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG os_vif [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:20:f7,bridge_name='br-int',has_traffic_filtering=True,id=708a7b8d-8aee-4623-9ce7-fc3026329b9a,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708a7b8d-8a') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap708a7b8d-8a, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap708a7b8d-8a, col_values=(('external_ids', {'iface-id': '708a7b8d-8aee-4623-9ce7-fc3026329b9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:20:f7', 'vm-uuid': '84979ec3-09d4-4463-a20b-ca5dcf6986de'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:34 user nova-compute[74681]: INFO os_vif [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:20:f7,bridge_name='br-int',has_traffic_filtering=True,id=708a7b8d-8aee-4623-9ce7-fc3026329b9a,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708a7b8d-8a')
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:16:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No VIF found with MAC fa:16:3e:7b:20:f7, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:16:35 user nova-compute[74681]: DEBUG nova.network.neutron [req-8ce129d5-3d57-4b9f-a9b7-8768b1d27b4f req-0a2fda0a-d305-4e7c-92ce-498143511e7a service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Updated VIF entry in instance network info cache for port 708a7b8d-8aee-4623-9ce7-fc3026329b9a. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:16:35 user nova-compute[74681]: DEBUG nova.network.neutron [req-8ce129d5-3d57-4b9f-a9b7-8768b1d27b4f req-0a2fda0a-d305-4e7c-92ce-498143511e7a service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Updating instance_info_cache with network_info: [{"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ce129d5-3d57-4b9f-a9b7-8768b1d27b4f req-0a2fda0a-d305-4e7c-92ce-498143511e7a service nova] Releasing lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:16:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:35 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:16:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Skipping network cache update for instance because it is Building. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 02e364f9-af4e-40bb-a0b4-2b1864f54270 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-355748e0-42b4-4e41-8800-4ae9684a0400 req-dd0101c4-96a8-4d90-ba79-ecc3a90c4396 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received event network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-355748e0-42b4-4e41-8800-4ae9684a0400 req-dd0101c4-96a8-4d90-ba79-ecc3a90c4396 service nova] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-355748e0-42b4-4e41-8800-4ae9684a0400 req-dd0101c4-96a8-4d90-ba79-ecc3a90c4396 service nova] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-355748e0-42b4-4e41-8800-4ae9684a0400 req-dd0101c4-96a8-4d90-ba79-ecc3a90c4396 service nova] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-355748e0-42b4-4e41-8800-4ae9684a0400 req-dd0101c4-96a8-4d90-ba79-ecc3a90c4396 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] No waiting events found dispatching network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:36 user nova-compute[74681]: WARNING nova.compute.manager [req-355748e0-42b4-4e41-8800-4ae9684a0400 req-dd0101c4-96a8-4d90-ba79-ecc3a90c4396 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received unexpected event network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a for instance with vm_state building and task_state spawning.
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:37 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updating instance_info_cache with network_info: [{"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-02e364f9-af4e-40bb-a0b4-2b1864f54270" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:16:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:16:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lazy-loading 'flavor' on Instance uuid 1790612d-e3f8-4f16-8b6a-74fc37df9d25 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:38 user nova-compute[74681]: INFO nova.compute.manager [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Attaching volume 969c56da-df21-40a9-be89-196114df25a8 to /dev/vdb
Aug 16 06:16:38 user nova-compute[74681]: DEBUG os_brick.utils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166598.5735178, 84979ec3-09d4-4463-a20b-ca5dcf6986de => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:16:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] VM Resumed (Lifecycle Event)
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:16:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Instance spawned successfully.
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f68de2-86d6-4efb-81ff-85ab93b91e32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa5d6f-241b-4b0d-916c-80c6dc1ddf42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166598.5766466, 84979ec3-09d4-4463-a20b-ca5dcf6986de => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:16:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] VM Started (Lifecycle Event)
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f27f20c-b9aa-4b64-91e9-725bed7c569d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bedb55a-9142-4e06-9fa7-a8eed31b76a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:38 user nova-compute[74681]: INFO nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Took 7.22 seconds to spawn the instance on the hypervisor.
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:16:38 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ec9e57-ec16-41d5-bbb7-b5eed49625e7]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG os_brick.utils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Updating existing volume attachment record: 9f4e9aa7-5f5d-4548-820b-49252f94ed86 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:16:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-c7bc01c2-a95a-4a95-8364-56f1573368ac req-e4f2c154-5e68-4909-9da0-8656a8c64440 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received event network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c7bc01c2-a95a-4a95-8364-56f1573368ac req-e4f2c154-5e68-4909-9da0-8656a8c64440 service nova] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c7bc01c2-a95a-4a95-8364-56f1573368ac req-e4f2c154-5e68-4909-9da0-8656a8c64440 service nova] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c7bc01c2-a95a-4a95-8364-56f1573368ac req-e4f2c154-5e68-4909-9da0-8656a8c64440 service nova] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-c7bc01c2-a95a-4a95-8364-56f1573368ac req-e4f2c154-5e68-4909-9da0-8656a8c64440 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] No waiting events found dispatching network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:38 user nova-compute[74681]: WARNING nova.compute.manager [req-c7bc01c2-a95a-4a95-8364-56f1573368ac req-e4f2c154-5e68-4909-9da0-8656a8c64440 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received unexpected event network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a for instance with vm_state building and task_state spawning.
Aug 16 06:16:38 user nova-compute[74681]: INFO nova.compute.manager [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Took 8.14 seconds to build instance.
Aug 16 06:16:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-faea8525-cc95-467a-a824-b5ed3dbb9fdd tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.303s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166586.7184865, 6fa74c3d-f621-4cf2-8763-6d75109fb113 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:16:41 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] VM Stopped (Lifecycle Event)
Aug 16 06:16:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-bc87da2a-3d28-4a68-9c17-1d60643a2ae3 None None] [instance: 6fa74c3d-f621-4cf2-8763-6d75109fb113] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:42 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:16:42 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7254MB free_disk=25.530990600585938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance d7bc97ea-3b81-488c-8c63-b83a351118d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 1790612d-e3f8-4f16-8b6a-74fc37df9d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance e7e44f1a-d07e-4b37-bed0-9cf141649d6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 84979ec3-09d4-4463-a20b-ca5dcf6986de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:16:42 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:16:43 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:16:43 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:16:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:16:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:16:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:16:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-7e52f78c-9722-4207-b389-204c461956e5 req-b173bdc8-4b12-4867-a226-6687895da48e service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-changed-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-7e52f78c-9722-4207-b389-204c461956e5 req-b173bdc8-4b12-4867-a226-6687895da48e service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Refreshing instance network info cache due to event network-changed-395eef1a-74ab-41c3-b9d0-db18c0cfbb82. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:16:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e52f78c-9722-4207-b389-204c461956e5 req-b173bdc8-4b12-4867-a226-6687895da48e service nova] Acquiring lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:16:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e52f78c-9722-4207-b389-204c461956e5 req-b173bdc8-4b12-4867-a226-6687895da48e service nova] Acquired lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:16:45 user nova-compute[74681]: DEBUG nova.network.neutron [req-7e52f78c-9722-4207-b389-204c461956e5 req-b173bdc8-4b12-4867-a226-6687895da48e service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Refreshing network info cache for port 395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:16:45 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166590.4431329, 90188af1-901c-453f-b113-133b1e86bc85 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:16:45 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 90188af1-901c-453f-b113-133b1e86bc85] VM Stopped (Lifecycle Event)
Aug 16 06:16:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d2c4090f-39b6-48a6-8217-cee390ce9985 None None] [instance: 90188af1-901c-453f-b113-133b1e86bc85] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:16:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-7e52f78c-9722-4207-b389-204c461956e5 req-b173bdc8-4b12-4867-a226-6687895da48e service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updated VIF entry in instance network info cache for port 395eef1a-74ab-41c3-b9d0-db18c0cfbb82. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:16:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-7e52f78c-9722-4207-b389-204c461956e5 req-b173bdc8-4b12-4867-a226-6687895da48e service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e52f78c-9722-4207-b389-204c461956e5 req-b173bdc8-4b12-4867-a226-6687895da48e service nova] Releasing lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWyLAjnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:16:48 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:16:48 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:16:48 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a66431-815e-4ef3-9dc2-82d7665f25c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:16:48 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.050s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4d9b53-f32c-4a47-9a03-1ee8cd4686de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8] added
Aug 16 06:16:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c9304-f2c8-404b-84ed-a229b6dbf9ee]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7f33d4-720f-41dc-85e4-70fef02f2131]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWyLAjnV {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWyLAjnV" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a58e05b-93bb-4daf-8f9b-74b621a2945b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NWyLAjnV'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[571aa2c4-4794-4235-b6a4-67f0099c058f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7d5727-f8cd-49ba-bc37-a8e111214f86]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:16:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:16:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5513884b-f577-4e7a-a323-6fbeda81a0d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8, portal: 172.16.0.220,3260]
Aug 16 06:16:48 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8, portal: 172.16.0.220,3260] successful.
Aug 16 06:16:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae403ec-ed41-49f0-9af3-c7c80fa422d5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[950a7d83-cdb5-4406-8216-0a1e4b65887c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:16:48 user nova-compute[74681]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 (non-flash)
Aug 16 06:16:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:16:48 user nova-compute[74681]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 (non-flash)
Aug 16 06:16:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a7bc4-92bf-4488-abb2-4718e6f34764]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:16:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWyLAjnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:16:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:16:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23765313238393535', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:16:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765313238393535', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:16:49 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lazy-loading 'flavor' on Instance uuid 1790612d-e3f8-4f16-8b6a-74fc37df9d25 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:16:49 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:16:49 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:16:49 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:16:49 user nova-compute[74681]:   <serial>969c56da-df21-40a9-be89-196114df25a8</serial>
Aug 16 06:16:49 user nova-compute[74681]: </disk>
Aug 16 06:16:49 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] No VIF found with MAC fa:16:3e:cb:e9:35, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a13be82-0a3f-4a5e-8651-041db78603f6 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.734s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:50 user nova-compute[74681]: INFO nova.compute.manager [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Terminating instance
Aug 16 06:16:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-34e565ba-e7ea-4584-80ce-170a5f849ba6 req-f237b9a0-b6b8-4646-9a3c-66e76b1e42ca service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received event network-vif-unplugged-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-34e565ba-e7ea-4584-80ce-170a5f849ba6 req-f237b9a0-b6b8-4646-9a3c-66e76b1e42ca service nova] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-34e565ba-e7ea-4584-80ce-170a5f849ba6 req-f237b9a0-b6b8-4646-9a3c-66e76b1e42ca service nova] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-34e565ba-e7ea-4584-80ce-170a5f849ba6 req-f237b9a0-b6b8-4646-9a3c-66e76b1e42ca service nova] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-34e565ba-e7ea-4584-80ce-170a5f849ba6 req-f237b9a0-b6b8-4646-9a3c-66e76b1e42ca service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] No waiting events found dispatching network-vif-unplugged-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-34e565ba-e7ea-4584-80ce-170a5f849ba6 req-f237b9a0-b6b8-4646-9a3c-66e76b1e42ca service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received event network-vif-unplugged-7333dc90-1346-4215-914a-1949024fb267 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:16:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Instance destroyed successfully.
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lazy-loading 'resources' on Instance uuid 1790612d-e3f8-4f16-8b6a-74fc37df9d25 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1145243347',display_name='tempest-DeleteServersTestJSON-server-1145243347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1145243347',id=16,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:14:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56e41e4931d94487a89388c76bb16130',ramdisk_id='',reservation_id='r-oo6sofqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1316362224',owner_user_name='tempest-DeleteServersTestJSON-1316362224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:14:50Z,user_data=None,user_id='67db7c024361435ab35c316c2dbfb25b',uuid=1790612d-e3f8-4f16-8b6a-74fc37df9d25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Converting VIF {"id": "7333dc90-1346-4215-914a-1949024fb267", "address": "fa:16:3e:cb:e9:35", "network": {"id": "9d4d591c-2994-4341-8dcd-62038d89982d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-747495174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e41e4931d94487a89388c76bb16130", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7333dc90-13", "ovs_interfaceid": "7333dc90-1346-4215-914a-1949024fb267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e9:35,bridge_name='br-int',has_traffic_filtering=True,id=7333dc90-1346-4215-914a-1949024fb267,network=Network(9d4d591c-2994-4341-8dcd-62038d89982d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7333dc90-13') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_vif [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e9:35,bridge_name='br-int',has_traffic_filtering=True,id=7333dc90-1346-4215-914a-1949024fb267,network=Network(9d4d591c-2994-4341-8dcd-62038d89982d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7333dc90-13') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7333dc90-13, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:16:51 user nova-compute[74681]: INFO os_vif [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e9:35,bridge_name='br-int',has_traffic_filtering=True,id=7333dc90-1346-4215-914a-1949024fb267,network=Network(9d4d591c-2994-4341-8dcd-62038d89982d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7333dc90-13')
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWyLAjnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:16:51 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713ee43-c429-495c-bdc8-6e6d6f78aa84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e343aa-6fba-411d-bbc9-8f2830c5c328]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:16:51 user nova-compute[74681]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 (non-flash)
Aug 16 06:16:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:16:51 user nova-compute[74681]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 (non-flash)
Aug 16 06:16:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9494353be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d105fb07-285e-475f-b2f4-aaf42c916359]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b5caec-1600-480c-a747-ef5a82b234f2]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f46ba88-f14e-4444-9747-e2ac5d642098]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7ef12a-677d-4cf7-a68d-8cb7653e3ac0]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0626af37-c117-42b6-ba43-3f752efe643a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[70582d53-7fdf-4027-8c17-001b56a67480]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8, portal: 172.16.0.220,3260]
Aug 16 06:16:51 user nova-compute[74681]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8, portal: 172.16.0.220,3260] successful.
Aug 16 06:16:51 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969c56da-df21-40a9-be89-196114df25a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d442a-9176-4877-a993-001ec4a32f06]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] <== disconnect_volume: return (319ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:16:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:16:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Deleting instance files /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25_del
Aug 16 06:16:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Deletion of /opt/stack/data/nova/instances/1790612d-e3f8-4f16-8b6a-74fc37df9d25_del complete
Aug 16 06:16:52 user nova-compute[74681]: INFO nova.compute.manager [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 16 06:16:52 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:16:52 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:16:52 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:16:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-88cc17c1-2c5f-4f8f-810b-04c809f6ef59 req-440ee4f4-f45e-461b-9f30-7097d1c65a63 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received event network-vif-deleted-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:52 user nova-compute[74681]: INFO nova.compute.manager [req-88cc17c1-2c5f-4f8f-810b-04c809f6ef59 req-440ee4f4-f45e-461b-9f30-7097d1c65a63 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Neutron deleted interface 7333dc90-1346-4215-914a-1949024fb267; detaching it from the instance and deleting it from the info cache
Aug 16 06:16:52 user nova-compute[74681]: DEBUG nova.network.neutron [req-88cc17c1-2c5f-4f8f-810b-04c809f6ef59 req-440ee4f4-f45e-461b-9f30-7097d1c65a63 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:52 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:16:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-88cc17c1-2c5f-4f8f-810b-04c809f6ef59 req-440ee4f4-f45e-461b-9f30-7097d1c65a63 service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Detach interface failed, port_id=7333dc90-1346-4215-914a-1949024fb267, reason: Instance 1790612d-e3f8-4f16-8b6a-74fc37df9d25 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:16:52 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Took 0.67 seconds to deallocate network for instance.
Aug 16 06:16:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-4e0c590d-4284-4ec7-98bb-e9addcc7578a req-6011ea4c-a54b-4121-8165-8bc751e5f57c service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received event network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:16:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e0c590d-4284-4ec7-98bb-e9addcc7578a req-6011ea4c-a54b-4121-8165-8bc751e5f57c service nova] Acquiring lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e0c590d-4284-4ec7-98bb-e9addcc7578a req-6011ea4c-a54b-4121-8165-8bc751e5f57c service nova] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e0c590d-4284-4ec7-98bb-e9addcc7578a req-6011ea4c-a54b-4121-8165-8bc751e5f57c service nova] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-4e0c590d-4284-4ec7-98bb-e9addcc7578a req-6011ea4c-a54b-4121-8165-8bc751e5f57c service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] No waiting events found dispatching network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:16:53 user nova-compute[74681]: WARNING nova.compute.manager [req-4e0c590d-4284-4ec7-98bb-e9addcc7578a req-6011ea4c-a54b-4121-8165-8bc751e5f57c service nova] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Received unexpected event network-vif-plugged-7333dc90-1346-4215-914a-1949024fb267 for instance with vm_state active and task_state deleting.
Aug 16 06:16:53 user nova-compute[74681]: INFO nova.compute.manager [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 06:16:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:16:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:16:53 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:16:53 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:16:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:53 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Deleted allocations for instance 1790612d-e3f8-4f16-8b6a-74fc37df9d25
Aug 16 06:16:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f957bd4f-bc15-4fb3-85e4-0a03d413b3b1 tempest-DeleteServersTestJSON-1316362224 tempest-DeleteServersTestJSON-1316362224-project-member] Lock "1790612d-e3f8-4f16-8b6a-74fc37df9d25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.248s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:16:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:16:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:06 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166611.5530903, 1790612d-e3f8-4f16-8b6a-74fc37df9d25 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:17:06 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] VM Stopped (Lifecycle Event)
Aug 16 06:17:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-17caa317-a36a-4703-80a8-ce5c2743c76d None None] [instance: 1790612d-e3f8-4f16-8b6a-74fc37df9d25] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:08 user nova-compute[74681]: INFO nova.compute.manager [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Terminating instance
Aug 16 06:17:08 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8d6f1b5-3d3a-4eae-aee3-bcda1a689537 req-840458e6-e663-4b56-a690-4519eb794c86 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8d6f1b5-3d3a-4eae-aee3-bcda1a689537 req-840458e6-e663-4b56-a690-4519eb794c86 service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8d6f1b5-3d3a-4eae-aee3-bcda1a689537 req-840458e6-e663-4b56-a690-4519eb794c86 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8d6f1b5-3d3a-4eae-aee3-bcda1a689537 req-840458e6-e663-4b56-a690-4519eb794c86 service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8d6f1b5-3d3a-4eae-aee3-bcda1a689537 req-840458e6-e663-4b56-a690-4519eb794c86 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:08 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8d6f1b5-3d3a-4eae-aee3-bcda1a689537 req-840458e6-e663-4b56-a690-4519eb794c86 service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-unplugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:17:09 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Instance destroyed successfully.
Aug 16 06:17:09 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lazy-loading 'resources' on Instance uuid d7bc97ea-3b81-488c-8c63-b83a351118d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1131256241',display_name='tempest-ServerStableDeviceRescueTest-server-1131256241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1131256241',id=4,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA5jr45P5sA8Q8jIF9YaPdfYu6PFHw4mwN8Wy/fnGh6GDyiFgbzHKdR3/VtJ5ZTpACv7rDzpNHLN7chunwDorI6Ro7a1PGSxtD5KWhK23AMyEgusmEgj7VTlSIETlWMsA==',key_name='tempest-keypair-1619526100',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc2558af74dc4c419b153219d7149dd7',ramdisk_id='',reservation_id='r-6im7okhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1481713468',owner_user_name='tempest-ServerStableDeviceRescueTest-1481713468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b24840d59e14692a62430236835c592',uuid=d7bc97ea-3b81-488c-8c63-b83a351118d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Converting VIF {"id": "cea7b68d-7124-4c01-94b1-73632f0c4000", "address": "fa:16:3e:b1:69:e0", "network": {"id": "87a2a009-9d19-43e6-aa94-a6dd1d7f5764", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-824982696-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2558af74dc4c419b153219d7149dd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea7b68d-71", "ovs_interfaceid": "cea7b68d-7124-4c01-94b1-73632f0c4000", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:69:e0,bridge_name='br-int',has_traffic_filtering=True,id=cea7b68d-7124-4c01-94b1-73632f0c4000,network=Network(87a2a009-9d19-43e6-aa94-a6dd1d7f5764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7b68d-71') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG os_vif [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:69:e0,bridge_name='br-int',has_traffic_filtering=True,id=cea7b68d-7124-4c01-94b1-73632f0c4000,network=Network(87a2a009-9d19-43e6-aa94-a6dd1d7f5764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7b68d-71') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcea7b68d-71, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:17:09 user nova-compute[74681]: INFO os_vif [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:69:e0,bridge_name='br-int',has_traffic_filtering=True,id=cea7b68d-7124-4c01-94b1-73632f0c4000,network=Network(87a2a009-9d19-43e6-aa94-a6dd1d7f5764),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea7b68d-71')
Aug 16 06:17:09 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Deleting instance files /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2_del
Aug 16 06:17:09 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Deletion of /opt/stack/data/nova/instances/d7bc97ea-3b81-488c-8c63-b83a351118d2_del complete
Aug 16 06:17:09 user nova-compute[74681]: INFO nova.compute.manager [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 06:17:09 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:17:09 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:17:10 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Took 0.79 seconds to deallocate network for instance.
Aug 16 06:17:10 user nova-compute[74681]: DEBUG nova.compute.manager [req-45828b43-7ea5-4325-a2ec-1d3690b9c4e9 req-7a4476f1-d7ee-40f6-81e7-463d8ba4413a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-deleted-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:10 user nova-compute[74681]: INFO nova.compute.manager [req-45828b43-7ea5-4325-a2ec-1d3690b9c4e9 req-7a4476f1-d7ee-40f6-81e7-463d8ba4413a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Neutron deleted interface cea7b68d-7124-4c01-94b1-73632f0c4000; detaching it from the instance and deleting it from the info cache
Aug 16 06:17:10 user nova-compute[74681]: DEBUG nova.network.neutron [req-45828b43-7ea5-4325-a2ec-1d3690b9c4e9 req-7a4476f1-d7ee-40f6-81e7-463d8ba4413a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG nova.compute.manager [req-45828b43-7ea5-4325-a2ec-1d3690b9c4e9 req-7a4476f1-d7ee-40f6-81e7-463d8ba4413a service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Detach interface failed, port_id=cea7b68d-7124-4c01-94b1-73632f0c4000, reason: Instance d7bc97ea-3b81-488c-8c63-b83a351118d2 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:10 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Deleted allocations for instance d7bc97ea-3b81-488c-8c63-b83a351118d2
Aug 16 06:17:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2562d9f3-c726-4dc2-874f-4f690b6d05ea tempest-ServerStableDeviceRescueTest-1481713468 tempest-ServerStableDeviceRescueTest-1481713468-project-member] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.251s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG nova.compute.manager [req-628c540a-17c4-4aea-aff6-7b181cb3d122 req-330122cd-6523-4688-b895-07ade4567cbe service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-628c540a-17c4-4aea-aff6-7b181cb3d122 req-330122cd-6523-4688-b895-07ade4567cbe service nova] Acquiring lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-628c540a-17c4-4aea-aff6-7b181cb3d122 req-330122cd-6523-4688-b895-07ade4567cbe service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-628c540a-17c4-4aea-aff6-7b181cb3d122 req-330122cd-6523-4688-b895-07ade4567cbe service nova] Lock "d7bc97ea-3b81-488c-8c63-b83a351118d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:10 user nova-compute[74681]: DEBUG nova.compute.manager [req-628c540a-17c4-4aea-aff6-7b181cb3d122 req-330122cd-6523-4688-b895-07ade4567cbe service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] No waiting events found dispatching network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:10 user nova-compute[74681]: WARNING nova.compute.manager [req-628c540a-17c4-4aea-aff6-7b181cb3d122 req-330122cd-6523-4688-b895-07ade4567cbe service nova] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Received unexpected event network-vif-plugged-cea7b68d-7124-4c01-94b1-73632f0c4000 for instance with vm_state deleted and task_state None.
Aug 16 06:17:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:24 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166629.3558056, d7bc97ea-3b81-488c-8c63-b83a351118d2 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:17:24 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] VM Stopped (Lifecycle Event)
Aug 16 06:17:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-6a3726eb-a233-49d7-aad1-7abde4951ec7 None None] [instance: d7bc97ea-3b81-488c-8c63-b83a351118d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:17:25 user nova-compute[74681]: INFO nova.compute.claims [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Claim successful on node user
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:17:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.policy [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e9ea2042eae46618172633ecf40bb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ed7ef3df024e178e16f79008239e48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:17:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Creating image(s)
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk 1073741824" returned: 0 in 0.063s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Successfully created port: e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Cannot resize image /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG nova.objects.instance [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'migration_context' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Ensure instance console log exists: /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Successfully updated port: e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquired lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-9d4c5017-36cf-4adf-ade9-dffb9480b0b4 req-b50e098a-3282-4f6c-bdd8-2517609bec42 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-changed-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-9d4c5017-36cf-4adf-ade9-dffb9480b0b4 req-b50e098a-3282-4f6c-bdd8-2517609bec42 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Refreshing instance network info cache due to event network-changed-e207d8ba-006f-49c7-8166-227fa1009a28. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9d4c5017-36cf-4adf-ade9-dffb9480b0b4 req-b50e098a-3282-4f6c-bdd8-2517609bec42 service nova] Acquiring lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updating instance_info_cache with network_info: [{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Releasing lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance network_info: |[{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9d4c5017-36cf-4adf-ade9-dffb9480b0b4 req-b50e098a-3282-4f6c-bdd8-2517609bec42 service nova] Acquired lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-9d4c5017-36cf-4adf-ade9-dffb9480b0b4 req-b50e098a-3282-4f6c-bdd8-2517609bec42 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Refreshing network info cache for port e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Start _get_guest_xml network_info=[{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:17:27 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:17:27 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1176396881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1176396881',id=22,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCpwDAIgdlWm3QRLdDXekBMeHU+NMDigNAkU342zi7/hIVEgAx/QvGX2TSqaNifbIdghzAwqEWT4JEoxkV1nm8yRPJ91JXtgmrMlWeL6vkPb0ppFUZrFgbC3YHx84+sZQ==',key_name='tempest-keypair-1791209110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-ktpwt4ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=20509fce-ff8d-4edc-85e9-c54375c274da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.objects.instance [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'pci_devices' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:17:27 user nova-compute[74681]:   <uuid>20509fce-ff8d-4edc-85e9-c54375c274da</uuid>
Aug 16 06:17:27 user nova-compute[74681]:   <name>instance-00000016</name>
Aug 16 06:17:27 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:17:27 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:17:27 user nova-compute[74681]:   <metadata>
Aug 16 06:17:27 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:17:27 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:17:27 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1176396881</nova:name>
Aug 16 06:17:27 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:17:27</nova:creationTime>
Aug 16 06:17:27 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:17:27 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:17:27 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:17:27 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:17:27 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:17:27 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:17:27 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:17:27 user nova-compute[74681]:       <nova:owner>
Aug 16 06:17:27 user nova-compute[74681]:         <nova:user uuid="2e9ea2042eae46618172633ecf40bb62">tempest-AttachVolumeShelveTestJSON-1422435949-project-member</nova:user>
Aug 16 06:17:27 user nova-compute[74681]:         <nova:project uuid="f7ed7ef3df024e178e16f79008239e48">tempest-AttachVolumeShelveTestJSON-1422435949</nova:project>
Aug 16 06:17:27 user nova-compute[74681]:       </nova:owner>
Aug 16 06:17:27 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:17:27 user nova-compute[74681]:       <nova:ports>
Aug 16 06:17:27 user nova-compute[74681]:         <nova:port uuid="e207d8ba-006f-49c7-8166-227fa1009a28">
Aug 16 06:17:27 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:17:27 user nova-compute[74681]:         </nova:port>
Aug 16 06:17:27 user nova-compute[74681]:       </nova:ports>
Aug 16 06:17:27 user nova-compute[74681]:     </nova:instance>
Aug 16 06:17:27 user nova-compute[74681]:   </metadata>
Aug 16 06:17:27 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:17:27 user nova-compute[74681]:     <system>
Aug 16 06:17:27 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:17:27 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:17:27 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:17:27 user nova-compute[74681]:       <entry name="serial">20509fce-ff8d-4edc-85e9-c54375c274da</entry>
Aug 16 06:17:27 user nova-compute[74681]:       <entry name="uuid">20509fce-ff8d-4edc-85e9-c54375c274da</entry>
Aug 16 06:17:27 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:17:27 user nova-compute[74681]:     </system>
Aug 16 06:17:27 user nova-compute[74681]:   </sysinfo>
Aug 16 06:17:27 user nova-compute[74681]:   <os>
Aug 16 06:17:27 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:17:27 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:17:27 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:17:27 user nova-compute[74681]:   </os>
Aug 16 06:17:27 user nova-compute[74681]:   <features>
Aug 16 06:17:27 user nova-compute[74681]:     <acpi/>
Aug 16 06:17:27 user nova-compute[74681]:     <apic/>
Aug 16 06:17:27 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:17:27 user nova-compute[74681]:   </features>
Aug 16 06:17:27 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:17:27 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:17:27 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:17:27 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:17:27 user nova-compute[74681]:   </clock>
Aug 16 06:17:27 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:17:27 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:17:27 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:17:27 user nova-compute[74681]:   </cpu>
Aug 16 06:17:27 user nova-compute[74681]:   <devices>
Aug 16 06:17:27 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:17:27 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:17:27 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk"/>
Aug 16 06:17:27 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:17:27 user nova-compute[74681]:     </disk>
Aug 16 06:17:27 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:17:27 user nova-compute[74681]:       <mac address="fa:16:3e:e7:12:a2"/>
Aug 16 06:17:27 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:17:27 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:17:27 user nova-compute[74681]:       <target dev="tape207d8ba-00"/>
Aug 16 06:17:27 user nova-compute[74681]:     </interface>
Aug 16 06:17:27 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:17:27 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/console.log" append="off"/>
Aug 16 06:17:27 user nova-compute[74681]:     </serial>
Aug 16 06:17:27 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:17:27 user nova-compute[74681]:     <video>
Aug 16 06:17:27 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:17:27 user nova-compute[74681]:     </video>
Aug 16 06:17:27 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:17:27 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:17:27 user nova-compute[74681]:     </rng>
Aug 16 06:17:27 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:17:27 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:17:27 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:17:27 user nova-compute[74681]:     </memballoon>
Aug 16 06:17:27 user nova-compute[74681]:   </devices>
Aug 16 06:17:27 user nova-compute[74681]: </domain>
Aug 16 06:17:27 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1176396881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1176396881',id=22,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCpwDAIgdlWm3QRLdDXekBMeHU+NMDigNAkU342zi7/hIVEgAx/QvGX2TSqaNifbIdghzAwqEWT4JEoxkV1nm8yRPJ91JXtgmrMlWeL6vkPb0ppFUZrFgbC3YHx84+sZQ==',key_name='tempest-keypair-1791209110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-ktpwt4ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=20509fce-ff8d-4edc-85e9-c54375c274da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG os_vif [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape207d8ba-00, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape207d8ba-00, col_values=(('external_ids', {'iface-id': 'e207d8ba-006f-49c7-8166-227fa1009a28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:12:a2', 'vm-uuid': '20509fce-ff8d-4edc-85e9-c54375c274da'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:17:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:27 user nova-compute[74681]: INFO os_vif [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00')
Aug 16 06:17:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:17:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No VIF found with MAC fa:16:3e:e7:12:a2, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:17:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-9d4c5017-36cf-4adf-ade9-dffb9480b0b4 req-b50e098a-3282-4f6c-bdd8-2517609bec42 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updated VIF entry in instance network info cache for port e207d8ba-006f-49c7-8166-227fa1009a28. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:17:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-9d4c5017-36cf-4adf-ade9-dffb9480b0b4 req-b50e098a-3282-4f6c-bdd8-2517609bec42 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updating instance_info_cache with network_info: [{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:17:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9d4c5017-36cf-4adf-ade9-dffb9480b0b4 req-b50e098a-3282-4f6c-bdd8-2517609bec42 service nova] Releasing lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:17:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655d8cb-6066-4d5e-bd39-85ce5e656b1a req-30ffa05b-78ff-43ef-a771-d15149ae2f62 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655d8cb-6066-4d5e-bd39-85ce5e656b1a req-30ffa05b-78ff-43ef-a771-d15149ae2f62 service nova] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655d8cb-6066-4d5e-bd39-85ce5e656b1a req-30ffa05b-78ff-43ef-a771-d15149ae2f62 service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8655d8cb-6066-4d5e-bd39-85ce5e656b1a req-30ffa05b-78ff-43ef-a771-d15149ae2f62 service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-8655d8cb-6066-4d5e-bd39-85ce5e656b1a req-30ffa05b-78ff-43ef-a771-d15149ae2f62 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] No waiting events found dispatching network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:30 user nova-compute[74681]: WARNING nova.compute.manager [req-8655d8cb-6066-4d5e-bd39-85ce5e656b1a req-30ffa05b-78ff-43ef-a771-d15149ae2f62 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received unexpected event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 for instance with vm_state building and task_state spawning.
Aug 16 06:17:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-57481233-e94e-466f-8d59-219d02c0791d req-ba77f415-7c11-4d41-9ab2-134029808552 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-changed-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-57481233-e94e-466f-8d59-219d02c0791d req-ba77f415-7c11-4d41-9ab2-134029808552 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Refreshing instance network info cache due to event network-changed-7a5e5902-78fd-4339-8aa2-91c8cd2cb239. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-57481233-e94e-466f-8d59-219d02c0791d req-ba77f415-7c11-4d41-9ab2-134029808552 service nova] Acquiring lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-57481233-e94e-466f-8d59-219d02c0791d req-ba77f415-7c11-4d41-9ab2-134029808552 service nova] Acquired lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-57481233-e94e-466f-8d59-219d02c0791d req-ba77f415-7c11-4d41-9ab2-134029808552 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Refreshing network info cache for port 7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166651.7367165, 20509fce-ff8d-4edc-85e9-c54375c274da => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:17:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] VM Resumed (Lifecycle Event)
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:17:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance spawned successfully.
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:17:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166651.7415853, 20509fce-ff8d-4edc-85e9-c54375c274da => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:17:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] VM Started (Lifecycle Event)
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:17:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:17:31 user nova-compute[74681]: INFO nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 16 06:17:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:32 user nova-compute[74681]: INFO nova.compute.manager [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Took 7.00 seconds to build instance.
Aug 16 06:17:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88607479-ebcd-44c2-aa90-500d74e2eec0 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.133s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-6fb5aedb-1156-42fc-966c-0c32027400b9 req-53f357ea-3c02-49db-8bd5-b6b7cec7165b service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fb5aedb-1156-42fc-966c-0c32027400b9 req-53f357ea-3c02-49db-8bd5-b6b7cec7165b service nova] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fb5aedb-1156-42fc-966c-0c32027400b9 req-53f357ea-3c02-49db-8bd5-b6b7cec7165b service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6fb5aedb-1156-42fc-966c-0c32027400b9 req-53f357ea-3c02-49db-8bd5-b6b7cec7165b service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-6fb5aedb-1156-42fc-966c-0c32027400b9 req-53f357ea-3c02-49db-8bd5-b6b7cec7165b service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] No waiting events found dispatching network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:32 user nova-compute[74681]: WARNING nova.compute.manager [req-6fb5aedb-1156-42fc-966c-0c32027400b9 req-53f357ea-3c02-49db-8bd5-b6b7cec7165b service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received unexpected event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 for instance with vm_state active and task_state None.
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-57481233-e94e-466f-8d59-219d02c0791d req-ba77f415-7c11-4d41-9ab2-134029808552 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updated VIF entry in instance network info cache for port 7a5e5902-78fd-4339-8aa2-91c8cd2cb239. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-57481233-e94e-466f-8d59-219d02c0791d req-ba77f415-7c11-4d41-9ab2-134029808552 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updating instance_info_cache with network_info: [{"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-57481233-e94e-466f-8d59-219d02c0791d req-ba77f415-7c11-4d41-9ab2-134029808552 service nova] Releasing lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:17:32 user nova-compute[74681]: INFO nova.compute.manager [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Rebuilding instance
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lazy-loading 'pci_requests' on Instance uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lazy-loading 'pci_devices' on Instance uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lazy-loading 'resources' on Instance uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lazy-loading 'migration_context' on Instance uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74681) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-501d6e35-72a2-49e1-b750-f24e49350c13 req-c97e9eee-861d-41fd-bd1c-602098bfdb10 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-unplugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-501d6e35-72a2-49e1-b750-f24e49350c13 req-c97e9eee-861d-41fd-bd1c-602098bfdb10 service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-501d6e35-72a2-49e1-b750-f24e49350c13 req-c97e9eee-861d-41fd-bd1c-602098bfdb10 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-501d6e35-72a2-49e1-b750-f24e49350c13 req-c97e9eee-861d-41fd-bd1c-602098bfdb10 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-501d6e35-72a2-49e1-b750-f24e49350c13 req-c97e9eee-861d-41fd-bd1c-602098bfdb10 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] No waiting events found dispatching network-vif-unplugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:33 user nova-compute[74681]: WARNING nova.compute.manager [req-501d6e35-72a2-49e1-b750-f24e49350c13 req-c97e9eee-861d-41fd-bd1c-602098bfdb10 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received unexpected event network-vif-unplugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 for instance with vm_state active and task_state rebuilding.
Aug 16 06:17:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance destroyed successfully.
Aug 16 06:17:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance destroyed successfully.
Aug 16 06:17:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-267678761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-808346252',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZrGW8nCbzlOoz04Zj2fEVg2OyB0Rht/GlEgqvRO5/aJEfk6k8Fi2kVkXuk25bslUvg9+k0B+zN2Q16i9fyuVIwokT7VL79iIqXpmvSbcoHpdzDKcJMOcxZjGPcryb0wg==',key_name='tempest-keypair-1235458036',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='824dea21de1d4cce8d70be10c5a5942b',ramdisk_id='',reservation_id='r-i4kh4yos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1593902319',owner_user_name='tempest-ServerActionsV293TestJSON-1593902319-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7666caaf93494e07baf06aca64090235',uuid=e7e44f1a-d07e-4b37-bed0-9cf141649d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converting VIF {"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_vif [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a5e5902-78, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:17:33 user nova-compute[74681]: INFO os_vif [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78')
Aug 16 06:17:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:17:33 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bbcf67-3693-416c-8643-29297245d0da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb739da0-27dc-4e95-88fe-d4959ae30dcc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:17:33 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:17:33 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94841ea950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75ce501-9545-4d10-bf7c-21ecf3ea40c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef69a250-a4a1-4b41-a864-2710a5532457]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d1dd4-d1ed-44da-add2-79856a376b18]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60d9fd9-f0c3-4cd7-aa7b-f0944a977302]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOada11c08-9f92123e136bbca1', '/dev/disk/by-id/scsi-23966393231323365', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ada11c08') {{(pid=121298) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d1116c-30e5-408f-b674-8b87b6ef3b34]: (4, None) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6aae37-371a-4577-8601-c36764ca0df1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cd65a0-b3a9-409c-8086-9e786cdb4ae1]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260]
Aug 16 06:17:34 user nova-compute[74681]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260] successful.
Aug 16 06:17:34 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b892b689-46f6-4367-8138-a46247780fd9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] <== disconnect_volume: return (315ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:17:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Deleting instance files /opt/stack/data/nova/instances/e7e44f1a-d07e-4b37-bed0-9cf141649d6d_del
Aug 16 06:17:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Deletion of /opt/stack/data/nova/instances/e7e44f1a-d07e-4b37-bed0-9cf141649d6d_del complete
Aug 16 06:17:34 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e7e44f1a-d07e-4b37-bed0-9cf141649d6d could not be found.
Aug 16 06:17:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:17:34 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73260a3-af95-4276-aa37-d5fe19894e78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: WARNING os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 16 06:17:34 user nova-compute[74681]: : NotImplementedError
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[512b1f68-1764-4f16-af68-7a252700c9e2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:17:34 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:17:34 user nova-compute[74681]:  {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:17:34 user nova-compute[74681]: WARNING os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 06:17:34 user nova-compute[74681]: : NotImplementedError
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f949426d090>, {}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Disconnecting from: [] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] <== disconnect_volume: return (57ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:17:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-8ab7e460-58d1-45d3-a5b8-8f353c76d867 req-9a87d089-8fa0-4c28-ae58-8dc8a79dc945 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ab7e460-58d1-45d3-a5b8-8f353c76d867 req-9a87d089-8fa0-4c28-ae58-8dc8a79dc945 service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ab7e460-58d1-45d3-a5b8-8f353c76d867 req-9a87d089-8fa0-4c28-ae58-8dc8a79dc945 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ab7e460-58d1-45d3-a5b8-8f353c76d867 req-9a87d089-8fa0-4c28-ae58-8dc8a79dc945 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-8ab7e460-58d1-45d3-a5b8-8f353c76d867 req-9a87d089-8fa0-4c28-ae58-8dc8a79dc945 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] No waiting events found dispatching network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:35 user nova-compute[74681]: WARNING nova.compute.manager [req-8ab7e460-58d1-45d3-a5b8-8f353c76d867 req-9a87d089-8fa0-4c28-ae58-8dc8a79dc945 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received unexpected event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 for instance with vm_state active and task_state rebuilding.
Aug 16 06:17:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Preparing to wait for external event volume-reimaged-4ce7b0de-d115-4b09-a780-a23b962bdf2d {{(pid=74681) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:17:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:17:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:17:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:43 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:17:43 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7620MB free_disk=25.640274047851562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance e7e44f1a-d07e-4b37-bed0-9cf141649d6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 84979ec3-09d4-4463-a20b-ca5dcf6986de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 20509fce-ff8d-4edc-85e9-c54375c274da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:17:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:17:46 user nova-compute[74681]: INFO nova.compute.manager [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Rescuing
Aug 16 06:17:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:17:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquired lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:17:46 user nova-compute[74681]: DEBUG nova.network.neutron [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updating instance_info_cache with network_info: [{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Releasing lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-a98221b1-fcc0-4b18-94f0-4446d3797455 req-c206226e-661b-4027-93b1-cc7a399e702b service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-unplugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a98221b1-fcc0-4b18-94f0-4446d3797455 req-c206226e-661b-4027-93b1-cc7a399e702b service nova] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a98221b1-fcc0-4b18-94f0-4446d3797455 req-c206226e-661b-4027-93b1-cc7a399e702b service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a98221b1-fcc0-4b18-94f0-4446d3797455 req-c206226e-661b-4027-93b1-cc7a399e702b service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-a98221b1-fcc0-4b18-94f0-4446d3797455 req-c206226e-661b-4027-93b1-cc7a399e702b service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] No waiting events found dispatching network-vif-unplugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:47 user nova-compute[74681]: WARNING nova.compute.manager [req-a98221b1-fcc0-4b18-94f0-4446d3797455 req-c206226e-661b-4027-93b1-cc7a399e702b service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received unexpected event network-vif-unplugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 for instance with vm_state active and task_state rescuing.
Aug 16 06:17:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Instance destroyed successfully.
Aug 16 06:17:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Attempting rescue
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74681) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Instance directory exists: not creating {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 06:17:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Creating image(s)
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.197s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue" returned: 0 in 0.120s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'migration_context' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Start _get_guest_xml network_info=[{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:6a:9b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'resources' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:48 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:17:48 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1319824773',display_name='tempest-ServerRescueNegativeTestJSON-server-1319824773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1319824773',id=20,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:16:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-webr75hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:16:06Z,user_data=None,user_id='830eea7441aa4c928dcb598a555e01cd',uuid=5e675215-481e-4a14-955a-d92d43671e1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:6a:9b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:6a:9b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:9b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9cebfa23-8934-4e08-9cf9-ac02c7f663b7,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cebfa23-89') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:17:48 user nova-compute[74681]:   <uuid>5e675215-481e-4a14-955a-d92d43671e1a</uuid>
Aug 16 06:17:48 user nova-compute[74681]:   <name>instance-00000014</name>
Aug 16 06:17:48 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:17:48 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:17:48 user nova-compute[74681]:   <metadata>
Aug 16 06:17:48 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:17:48 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:17:48 user nova-compute[74681]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1319824773</nova:name>
Aug 16 06:17:48 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:17:48</nova:creationTime>
Aug 16 06:17:48 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:17:48 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:17:48 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:17:48 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:17:48 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:17:48 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:17:48 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:17:48 user nova-compute[74681]:       <nova:owner>
Aug 16 06:17:48 user nova-compute[74681]:         <nova:user uuid="830eea7441aa4c928dcb598a555e01cd">tempest-ServerRescueNegativeTestJSON-472247401-project-member</nova:user>
Aug 16 06:17:48 user nova-compute[74681]:         <nova:project uuid="ce6d58d07b1145b493d5a07a40c1eb0c">tempest-ServerRescueNegativeTestJSON-472247401</nova:project>
Aug 16 06:17:48 user nova-compute[74681]:       </nova:owner>
Aug 16 06:17:48 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:17:48 user nova-compute[74681]:       <nova:ports>
Aug 16 06:17:48 user nova-compute[74681]:         <nova:port uuid="9cebfa23-8934-4e08-9cf9-ac02c7f663b7">
Aug 16 06:17:48 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 06:17:48 user nova-compute[74681]:         </nova:port>
Aug 16 06:17:48 user nova-compute[74681]:       </nova:ports>
Aug 16 06:17:48 user nova-compute[74681]:     </nova:instance>
Aug 16 06:17:48 user nova-compute[74681]:   </metadata>
Aug 16 06:17:48 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:17:48 user nova-compute[74681]:     <system>
Aug 16 06:17:48 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:17:48 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:17:48 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:17:48 user nova-compute[74681]:       <entry name="serial">5e675215-481e-4a14-955a-d92d43671e1a</entry>
Aug 16 06:17:48 user nova-compute[74681]:       <entry name="uuid">5e675215-481e-4a14-955a-d92d43671e1a</entry>
Aug 16 06:17:48 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:17:48 user nova-compute[74681]:     </system>
Aug 16 06:17:48 user nova-compute[74681]:   </sysinfo>
Aug 16 06:17:48 user nova-compute[74681]:   <os>
Aug 16 06:17:48 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:17:48 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:17:48 user nova-compute[74681]:   </os>
Aug 16 06:17:48 user nova-compute[74681]:   <features>
Aug 16 06:17:48 user nova-compute[74681]:     <acpi/>
Aug 16 06:17:48 user nova-compute[74681]:     <apic/>
Aug 16 06:17:48 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:17:48 user nova-compute[74681]:   </features>
Aug 16 06:17:48 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:17:48 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:17:48 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:17:48 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:17:48 user nova-compute[74681]:   </clock>
Aug 16 06:17:48 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:17:48 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:17:48 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:17:48 user nova-compute[74681]:   </cpu>
Aug 16 06:17:48 user nova-compute[74681]:   <devices>
Aug 16 06:17:48 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:17:48 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:17:48 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue"/>
Aug 16 06:17:48 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:17:48 user nova-compute[74681]:     </disk>
Aug 16 06:17:48 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:17:48 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:17:48 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk"/>
Aug 16 06:17:48 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:17:48 user nova-compute[74681]:     </disk>
Aug 16 06:17:48 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:17:48 user nova-compute[74681]:       <mac address="fa:16:3e:6a:9b:eb"/>
Aug 16 06:17:48 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:17:48 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:17:48 user nova-compute[74681]:       <target dev="tap9cebfa23-89"/>
Aug 16 06:17:48 user nova-compute[74681]:     </interface>
Aug 16 06:17:48 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:17:48 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/console.log" append="off"/>
Aug 16 06:17:48 user nova-compute[74681]:     </serial>
Aug 16 06:17:48 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:17:48 user nova-compute[74681]:     <video>
Aug 16 06:17:48 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:17:48 user nova-compute[74681]:     </video>
Aug 16 06:17:48 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:17:48 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:17:48 user nova-compute[74681]:     </rng>
Aug 16 06:17:48 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:17:48 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:17:48 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:17:48 user nova-compute[74681]:     </memballoon>
Aug 16 06:17:48 user nova-compute[74681]:   </devices>
Aug 16 06:17:48 user nova-compute[74681]: </domain>
Aug 16 06:17:48 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:17:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Instance destroyed successfully.
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No VIF found with MAC fa:16:3e:6a:9b:eb, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166653.850309, e7e44f1a-d07e-4b37-bed0-9cf141649d6d => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:17:48 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] VM Stopped (Lifecycle Event)
Aug 16 06:17:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:48 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f39ac470-c42b-4439-8624-c2184d4eca73 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-b610fa17-dea8-4667-8147-7cd8756a7fae req-aeef6786-904b-49f0-b33d-48d8389e7cb3 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b610fa17-dea8-4667-8147-7cd8756a7fae req-aeef6786-904b-49f0-b33d-48d8389e7cb3 service nova] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b610fa17-dea8-4667-8147-7cd8756a7fae req-aeef6786-904b-49f0-b33d-48d8389e7cb3 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b610fa17-dea8-4667-8147-7cd8756a7fae req-aeef6786-904b-49f0-b33d-48d8389e7cb3 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-b610fa17-dea8-4667-8147-7cd8756a7fae req-aeef6786-904b-49f0-b33d-48d8389e7cb3 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] No waiting events found dispatching network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:49 user nova-compute[74681]: WARNING nova.compute.manager [req-b610fa17-dea8-4667-8147-7cd8756a7fae req-aeef6786-904b-49f0-b33d-48d8389e7cb3 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received unexpected event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 for instance with vm_state active and task_state rescuing.
Aug 16 06:17:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] No waiting events found dispatching network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:51 user nova-compute[74681]: WARNING nova.compute.manager [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received unexpected event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 for instance with vm_state active and task_state rescuing.
Aug 16 06:17:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] No waiting events found dispatching network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:17:51 user nova-compute[74681]: WARNING nova.compute.manager [req-50de9890-8729-4292-83cb-2ef0fb302fc3 req-acbe5321-0e53-4b21-bfaa-863e671acf27 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received unexpected event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 for instance with vm_state active and task_state rescuing.
Aug 16 06:17:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for 5e675215-481e-4a14-955a-d92d43671e1a due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:17:53 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166673.0859861, 5e675215-481e-4a14-955a-d92d43671e1a => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:17:53 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] VM Resumed (Lifecycle Event)
Aug 16 06:17:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-59aa86a5-abb9-484c-a2be-1ac7fda1ba78 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:17:53 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 06:17:53 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166673.0905101, 5e675215-481e-4a14-955a-d92d43671e1a => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:17:53 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] VM Started (Lifecycle Event)
Aug 16 06:17:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:17:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:17:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-a91b410e-bcd6-4976-84e9-413849779bee req-b16d9ef5-4375-41b4-9cff-b6454fd84adb service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event volume-reimaged-4ce7b0de-d115-4b09-a780-a23b962bdf2d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a91b410e-bcd6-4976-84e9-413849779bee req-b16d9ef5-4375-41b4-9cff-b6454fd84adb service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a91b410e-bcd6-4976-84e9-413849779bee req-b16d9ef5-4375-41b4-9cff-b6454fd84adb service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a91b410e-bcd6-4976-84e9-413849779bee req-b16d9ef5-4375-41b4-9cff-b6454fd84adb service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-a91b410e-bcd6-4976-84e9-413849779bee req-b16d9ef5-4375-41b4-9cff-b6454fd84adb service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Processing event volume-reimaged-4ce7b0de-d115-4b09-a780-a23b962bdf2d {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:17:59 user nova-compute[74681]: INFO nova.virt.block_device [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Booting with volume 4ce7b0de-d115-4b09-a780-a23b962bdf2d at /dev/vda
Aug 16 06:17:59 user nova-compute[74681]: DEBUG os_brick.utils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda685ea-7670-49ae-86e8-260409ba183b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1501b-15fd-445f-a1e7-3bec93f95e6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e74d15e-848e-4ec5-ae14-186ffbe0f2a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7540ebe-2990-4ed0-82ad-602e8df33fcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:17:59 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:17:59 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb330aaf-793c-484e-8a01-60680d50fffa]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG os_brick.utils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:17:59 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updating existing volume attachment record: 10b20c05-f414-4e66-9bb7-970ec9facf31 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:18:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:18:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Creating image(s)
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Ensure instance console log exists: /opt/stack/data/nova/instances/e7e44f1a-d07e-4b37-bed0-9cf141649d6d/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Start _get_guest_xml network_info=[{"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '10b20c05-f414-4e66-9bb7-970ec9facf31', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7e44f1a-d07e-4b37-bed0-9cf141649d6d', 'attached_at': '', 'detached_at': '', 'volume_id': '4ce7b0de-d115-4b09-a780-a23b962bdf2d', 'serial': '4ce7b0de-d115-4b09-a780-a23b962bdf2d'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:18:10 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 06:18:10 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:18:10 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:18:10 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:18:10 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f608709-d6b4-480f-8a98-55186b830caf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:18:10 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9641ecd1-d353-4992-b054-871920979991]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d] added
Aug 16 06:18:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[183cdb20-79ea-4cb5-a254-051d04a9c2de]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d3f164-ef57-4a37-88c8-09e5ac345a4c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHeMcTVX {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zHeMcTVX" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb4492-d985-4324-9eb2-da74edd2285d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zHeMcTVX'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeba631-f214-428e-ab1a-4389ec35138c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8644b10f-1ce4-4c4d-bf92-4350a9371fbf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:18:10 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:18:10 user nova-compute[74681]:  {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:18:10 user nova-compute[74681]: WARNING os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 06:18:10 user nova-compute[74681]: : NotImplementedError
Aug 16 06:18:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe9caa4-a68c-43f4-96a9-76b638d27d2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260]
Aug 16 06:18:11 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260] successful.
Aug 16 06:18:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff785279-1acc-4c00-be4d-5bb9a6d12582]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f97082-8ce9-415d-985d-31addf015e6e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:18:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:18:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f991b862-35ee-4730-8947-b8b1e1c28ed7]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:18:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23966393231323365', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966393231323365', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-267678761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-808346252',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZrGW8nCbzlOoz04Zj2fEVg2OyB0Rht/GlEgqvRO5/aJEfk6k8Fi2kVkXuk25bslUvg9+k0B+zN2Q16i9fyuVIwokT7VL79iIqXpmvSbcoHpdzDKcJMOcxZjGPcryb0wg==',key_name='tempest-keypair-1235458036',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='824dea21de1d4cce8d70be10c5a5942b',ramdisk_id='',reservation_id='r-i4kh4yos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1593902319',owner_user_name='tempest-ServerActionsV293TestJSON-1593902319-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7666caaf93494e07baf06aca64090235',uuid=e7e44f1a-d07e-4b37-bed0-9cf141649d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converting VIF {"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:18:12 user nova-compute[74681]:   <uuid>e7e44f1a-d07e-4b37-bed0-9cf141649d6d</uuid>
Aug 16 06:18:12 user nova-compute[74681]:   <name>instance-00000012</name>
Aug 16 06:18:12 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:18:12 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:18:12 user nova-compute[74681]:   <metadata>
Aug 16 06:18:12 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:18:12 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:18:12 user nova-compute[74681]:       <nova:name>tempest-ServerActionsV293TestJSON-server-267678761</nova:name>
Aug 16 06:18:12 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:18:10</nova:creationTime>
Aug 16 06:18:12 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:18:12 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:18:12 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:18:12 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:18:12 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:18:12 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:18:12 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:18:12 user nova-compute[74681]:       <nova:owner>
Aug 16 06:18:12 user nova-compute[74681]:         <nova:user uuid="7666caaf93494e07baf06aca64090235">tempest-ServerActionsV293TestJSON-1593902319-project-member</nova:user>
Aug 16 06:18:12 user nova-compute[74681]:         <nova:project uuid="824dea21de1d4cce8d70be10c5a5942b">tempest-ServerActionsV293TestJSON-1593902319</nova:project>
Aug 16 06:18:12 user nova-compute[74681]:       </nova:owner>
Aug 16 06:18:12 user nova-compute[74681]:       <nova:ports>
Aug 16 06:18:12 user nova-compute[74681]:         <nova:port uuid="7a5e5902-78fd-4339-8aa2-91c8cd2cb239">
Aug 16 06:18:12 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:18:12 user nova-compute[74681]:         </nova:port>
Aug 16 06:18:12 user nova-compute[74681]:       </nova:ports>
Aug 16 06:18:12 user nova-compute[74681]:     </nova:instance>
Aug 16 06:18:12 user nova-compute[74681]:   </metadata>
Aug 16 06:18:12 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:18:12 user nova-compute[74681]:     <system>
Aug 16 06:18:12 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:18:12 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:18:12 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:18:12 user nova-compute[74681]:       <entry name="serial">e7e44f1a-d07e-4b37-bed0-9cf141649d6d</entry>
Aug 16 06:18:12 user nova-compute[74681]:       <entry name="uuid">e7e44f1a-d07e-4b37-bed0-9cf141649d6d</entry>
Aug 16 06:18:12 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:18:12 user nova-compute[74681]:     </system>
Aug 16 06:18:12 user nova-compute[74681]:   </sysinfo>
Aug 16 06:18:12 user nova-compute[74681]:   <os>
Aug 16 06:18:12 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:18:12 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:18:12 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:18:12 user nova-compute[74681]:   </os>
Aug 16 06:18:12 user nova-compute[74681]:   <features>
Aug 16 06:18:12 user nova-compute[74681]:     <acpi/>
Aug 16 06:18:12 user nova-compute[74681]:     <apic/>
Aug 16 06:18:12 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:18:12 user nova-compute[74681]:   </features>
Aug 16 06:18:12 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:18:12 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:18:12 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:18:12 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:18:12 user nova-compute[74681]:   </clock>
Aug 16 06:18:12 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:18:12 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:18:12 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:18:12 user nova-compute[74681]:   </cpu>
Aug 16 06:18:12 user nova-compute[74681]:   <devices>
Aug 16 06:18:12 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:18:12 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:18:12 user nova-compute[74681]:       <source dev="/dev/sdb"/>
Aug 16 06:18:12 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:18:12 user nova-compute[74681]:       <serial>4ce7b0de-d115-4b09-a780-a23b962bdf2d</serial>
Aug 16 06:18:12 user nova-compute[74681]:     </disk>
Aug 16 06:18:12 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:18:12 user nova-compute[74681]:       <mac address="fa:16:3e:6a:71:f4"/>
Aug 16 06:18:12 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:12 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:18:12 user nova-compute[74681]:       <target dev="tap7a5e5902-78"/>
Aug 16 06:18:12 user nova-compute[74681]:     </interface>
Aug 16 06:18:12 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:18:12 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/e7e44f1a-d07e-4b37-bed0-9cf141649d6d/console.log" append="off"/>
Aug 16 06:18:12 user nova-compute[74681]:     </serial>
Aug 16 06:18:12 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:18:12 user nova-compute[74681]:     <video>
Aug 16 06:18:12 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:12 user nova-compute[74681]:     </video>
Aug 16 06:18:12 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:18:12 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:18:12 user nova-compute[74681]:     </rng>
Aug 16 06:18:12 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:18:12 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:18:12 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:18:12 user nova-compute[74681]:     </memballoon>
Aug 16 06:18:12 user nova-compute[74681]:   </devices>
Aug 16 06:18:12 user nova-compute[74681]: </domain>
Aug 16 06:18:12 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-267678761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-808346252',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZrGW8nCbzlOoz04Zj2fEVg2OyB0Rht/GlEgqvRO5/aJEfk6k8Fi2kVkXuk25bslUvg9+k0B+zN2Q16i9fyuVIwokT7VL79iIqXpmvSbcoHpdzDKcJMOcxZjGPcryb0wg==',key_name='tempest-keypair-1235458036',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='824dea21de1d4cce8d70be10c5a5942b',ramdisk_id='',reservation_id='r-i4kh4yos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1593902319',owner_user_name='tempest-ServerActionsV293TestJSON-1593902319-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7666caaf93494e07baf06aca64090235',uuid=e7e44f1a-d07e-4b37-bed0-9cf141649d6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converting VIF {"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG os_vif [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a5e5902-78, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a5e5902-78, col_values=(('external_ids', {'iface-id': '7a5e5902-78fd-4339-8aa2-91c8cd2cb239', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:71:f4', 'vm-uuid': 'e7e44f1a-d07e-4b37-bed0-9cf141649d6d'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:12 user nova-compute[74681]: INFO os_vif [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78')
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:18:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] No VIF found with MAC fa:16:3e:6a:71:f4, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:18:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166696.5374327, e7e44f1a-d07e-4b37-bed0-9cf141649d6d => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:16 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] VM Resumed (Lifecycle Event)
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:18:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance spawned successfully.
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:16 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166696.5401447, e7e44f1a-d07e-4b37-bed0-9cf141649d6d => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:16 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] VM Started (Lifecycle Event)
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:16 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74681) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 06:18:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a91b410e-bcd6-4976-84e9-413849779bee tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.134s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-857e7973-259b-4acd-b1fd-4f63875db6c9 req-20430ed9-abfd-44d7-afd5-cf24fb8c35d2 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-857e7973-259b-4acd-b1fd-4f63875db6c9 req-20430ed9-abfd-44d7-afd5-cf24fb8c35d2 service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-857e7973-259b-4acd-b1fd-4f63875db6c9 req-20430ed9-abfd-44d7-afd5-cf24fb8c35d2 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-857e7973-259b-4acd-b1fd-4f63875db6c9 req-20430ed9-abfd-44d7-afd5-cf24fb8c35d2 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-857e7973-259b-4acd-b1fd-4f63875db6c9 req-20430ed9-abfd-44d7-afd5-cf24fb8c35d2 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] No waiting events found dispatching network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:17 user nova-compute[74681]: WARNING nova.compute.manager [req-857e7973-259b-4acd-b1fd-4f63875db6c9 req-20430ed9-abfd-44d7-afd5-cf24fb8c35d2 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received unexpected event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 for instance with vm_state active and task_state None.
Aug 16 06:18:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:17 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:18:17 user nova-compute[74681]: INFO nova.compute.claims [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Claim successful on node user
Aug 16 06:18:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:18 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:18:18 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.989s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.network.neutron [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:18:19 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-4ad1bf82-02ae-4c86-ba47-3091d9338ea4 req-b7c23512-6702-4e39-b142-e71a42bd3942 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4ad1bf82-02ae-4c86-ba47-3091d9338ea4 req-b7c23512-6702-4e39-b142-e71a42bd3942 service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4ad1bf82-02ae-4c86-ba47-3091d9338ea4 req-b7c23512-6702-4e39-b142-e71a42bd3942 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4ad1bf82-02ae-4c86-ba47-3091d9338ea4 req-b7c23512-6702-4e39-b142-e71a42bd3942 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-4ad1bf82-02ae-4c86-ba47-3091d9338ea4 req-b7c23512-6702-4e39-b142-e71a42bd3942 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] No waiting events found dispatching network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:19 user nova-compute[74681]: WARNING nova.compute.manager [req-4ad1bf82-02ae-4c86-ba47-3091d9338ea4 req-b7c23512-6702-4e39-b142-e71a42bd3942 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received unexpected event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 for instance with vm_state active and task_state None.
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.policy [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac2515512dca4405b1f3ba2ba988ee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23594847d83142ddb1c59f9673591bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:18:19 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Creating image(s)
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "/opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "/opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.205s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.217s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk 1073741824" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.208s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG nova.network.neutron [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Successfully created port: a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Cannot resize image /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG nova.objects.instance [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'migration_context' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Ensure instance console log exists: /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Successfully updated port: a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquired lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-02a90e5e-ec17-4172-a5b4-8887cd41bae2 req-7e0d7ae8-9110-416d-b07d-1eaf1d8cc10c service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received event network-changed-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-02a90e5e-ec17-4172-a5b4-8887cd41bae2 req-7e0d7ae8-9110-416d-b07d-1eaf1d8cc10c service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Refreshing instance network info cache due to event network-changed-a1fe3499-88a0-4b80-81a2-8d1a4da52b14. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02a90e5e-ec17-4172-a5b4-8887cd41bae2 req-7e0d7ae8-9110-416d-b07d-1eaf1d8cc10c service nova] Acquiring lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2c8afc4-5223-447c-b0bc-a622de3699ec req-e31b4219-3365-42a4-8f92-e5c509ece936 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received event network-changed-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2c8afc4-5223-447c-b0bc-a622de3699ec req-e31b4219-3365-42a4-8f92-e5c509ece936 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Refreshing instance network info cache due to event network-changed-708a7b8d-8aee-4623-9ce7-fc3026329b9a. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2c8afc4-5223-447c-b0bc-a622de3699ec req-e31b4219-3365-42a4-8f92-e5c509ece936 service nova] Acquiring lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2c8afc4-5223-447c-b0bc-a622de3699ec req-e31b4219-3365-42a4-8f92-e5c509ece936 service nova] Acquired lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:21 user nova-compute[74681]: DEBUG nova.network.neutron [req-c2c8afc4-5223-447c-b0bc-a622de3699ec req-e31b4219-3365-42a4-8f92-e5c509ece936 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Refreshing network info cache for port 708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Updating instance_info_cache with network_info: [{"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Releasing lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Instance network_info: |[{"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02a90e5e-ec17-4172-a5b4-8887cd41bae2 req-7e0d7ae8-9110-416d-b07d-1eaf1d8cc10c service nova] Acquired lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.network.neutron [req-02a90e5e-ec17-4172-a5b4-8887cd41bae2 req-7e0d7ae8-9110-416d-b07d-1eaf1d8cc10c service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Refreshing network info cache for port a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Start _get_guest_xml network_info=[{"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:18:22 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:22 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-424669805',display_name='tempest-TestServerVolumeAttachmentScenario-server-424669805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-424669805',id=23,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC0i6pQb8owEi3iKtlBr94k4/yCYEYByLjdQcYgvlhoJTktOJIxL1iyn3jgYvZPTRQ1dzHSHsyaxfHK46x1pn7Je+rMPF5R0G9kqagR39UqRV7JAL0p5qLvoOHveLa38A==',key_name='tempest-keypair-980930394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23594847d83142ddb1c59f9673591bcd',ramdisk_id='',reservation_id='r-837ftmzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-927507447',owner_user_name='tempest-TestServerVolumeAttachmentScenario-927507447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac2515512dca4405b1f3ba2ba988ee84',uuid=ee235b33-937c-41f4-9052-fc7f9f200cbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Converting VIF {"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=a1fe3499-88a0-4b80-81a2-8d1a4da52b14,network=Network(5813a18d-712b-4498-b411-3ace04ad24f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fe3499-88') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.objects.instance [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'pci_devices' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:18:22 user nova-compute[74681]:   <uuid>ee235b33-937c-41f4-9052-fc7f9f200cbe</uuid>
Aug 16 06:18:22 user nova-compute[74681]:   <name>instance-00000017</name>
Aug 16 06:18:22 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:18:22 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:18:22 user nova-compute[74681]:   <metadata>
Aug 16 06:18:22 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:18:22 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:18:22 user nova-compute[74681]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-424669805</nova:name>
Aug 16 06:18:22 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:18:22</nova:creationTime>
Aug 16 06:18:22 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:18:22 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:18:22 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:18:22 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:18:22 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:18:22 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:18:22 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:18:22 user nova-compute[74681]:       <nova:owner>
Aug 16 06:18:22 user nova-compute[74681]:         <nova:user uuid="ac2515512dca4405b1f3ba2ba988ee84">tempest-TestServerVolumeAttachmentScenario-927507447-project-member</nova:user>
Aug 16 06:18:22 user nova-compute[74681]:         <nova:project uuid="23594847d83142ddb1c59f9673591bcd">tempest-TestServerVolumeAttachmentScenario-927507447</nova:project>
Aug 16 06:18:22 user nova-compute[74681]:       </nova:owner>
Aug 16 06:18:22 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:18:22 user nova-compute[74681]:       <nova:ports>
Aug 16 06:18:22 user nova-compute[74681]:         <nova:port uuid="a1fe3499-88a0-4b80-81a2-8d1a4da52b14">
Aug 16 06:18:22 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:18:22 user nova-compute[74681]:         </nova:port>
Aug 16 06:18:22 user nova-compute[74681]:       </nova:ports>
Aug 16 06:18:22 user nova-compute[74681]:     </nova:instance>
Aug 16 06:18:22 user nova-compute[74681]:   </metadata>
Aug 16 06:18:22 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:18:22 user nova-compute[74681]:     <system>
Aug 16 06:18:22 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:18:22 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:18:22 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:18:22 user nova-compute[74681]:       <entry name="serial">ee235b33-937c-41f4-9052-fc7f9f200cbe</entry>
Aug 16 06:18:22 user nova-compute[74681]:       <entry name="uuid">ee235b33-937c-41f4-9052-fc7f9f200cbe</entry>
Aug 16 06:18:22 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:18:22 user nova-compute[74681]:     </system>
Aug 16 06:18:22 user nova-compute[74681]:   </sysinfo>
Aug 16 06:18:22 user nova-compute[74681]:   <os>
Aug 16 06:18:22 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:18:22 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:18:22 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:18:22 user nova-compute[74681]:   </os>
Aug 16 06:18:22 user nova-compute[74681]:   <features>
Aug 16 06:18:22 user nova-compute[74681]:     <acpi/>
Aug 16 06:18:22 user nova-compute[74681]:     <apic/>
Aug 16 06:18:22 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:18:22 user nova-compute[74681]:   </features>
Aug 16 06:18:22 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:18:22 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:18:22 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:18:22 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:18:22 user nova-compute[74681]:   </clock>
Aug 16 06:18:22 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:18:22 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:18:22 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:18:22 user nova-compute[74681]:   </cpu>
Aug 16 06:18:22 user nova-compute[74681]:   <devices>
Aug 16 06:18:22 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:18:22 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:18:22 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk"/>
Aug 16 06:18:22 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:18:22 user nova-compute[74681]:     </disk>
Aug 16 06:18:22 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:18:22 user nova-compute[74681]:       <mac address="fa:16:3e:cf:89:fd"/>
Aug 16 06:18:22 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:22 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:18:22 user nova-compute[74681]:       <target dev="tapa1fe3499-88"/>
Aug 16 06:18:22 user nova-compute[74681]:     </interface>
Aug 16 06:18:22 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:18:22 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/console.log" append="off"/>
Aug 16 06:18:22 user nova-compute[74681]:     </serial>
Aug 16 06:18:22 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:18:22 user nova-compute[74681]:     <video>
Aug 16 06:18:22 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:22 user nova-compute[74681]:     </video>
Aug 16 06:18:22 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:18:22 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:18:22 user nova-compute[74681]:     </rng>
Aug 16 06:18:22 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:18:22 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:18:22 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:18:22 user nova-compute[74681]:     </memballoon>
Aug 16 06:18:22 user nova-compute[74681]:   </devices>
Aug 16 06:18:22 user nova-compute[74681]: </domain>
Aug 16 06:18:22 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-424669805',display_name='tempest-TestServerVolumeAttachmentScenario-server-424669805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-424669805',id=23,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC0i6pQb8owEi3iKtlBr94k4/yCYEYByLjdQcYgvlhoJTktOJIxL1iyn3jgYvZPTRQ1dzHSHsyaxfHK46x1pn7Je+rMPF5R0G9kqagR39UqRV7JAL0p5qLvoOHveLa38A==',key_name='tempest-keypair-980930394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23594847d83142ddb1c59f9673591bcd',ramdisk_id='',reservation_id='r-837ftmzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-927507447',owner_user_name='tempest-TestServerVolumeAttachmentScenario-927507447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac2515512dca4405b1f3ba2ba988ee84',uuid=ee235b33-937c-41f4-9052-fc7f9f200cbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Converting VIF {"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=a1fe3499-88a0-4b80-81a2-8d1a4da52b14,network=Network(5813a18d-712b-4498-b411-3ace04ad24f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fe3499-88') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG os_vif [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=a1fe3499-88a0-4b80-81a2-8d1a4da52b14,network=Network(5813a18d-712b-4498-b411-3ace04ad24f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fe3499-88') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1fe3499-88, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1fe3499-88, col_values=(('external_ids', {'iface-id': 'a1fe3499-88a0-4b80-81a2-8d1a4da52b14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:89:fd', 'vm-uuid': 'ee235b33-937c-41f4-9052-fc7f9f200cbe'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:18:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:22 user nova-compute[74681]: INFO os_vif [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=a1fe3499-88a0-4b80-81a2-8d1a4da52b14,network=Network(5813a18d-712b-4498-b411-3ace04ad24f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fe3499-88')
Aug 16 06:18:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No VIF found with MAC fa:16:3e:cf:89:fd, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-c2c8afc4-5223-447c-b0bc-a622de3699ec req-e31b4219-3365-42a4-8f92-e5c509ece936 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Updated VIF entry in instance network info cache for port 708a7b8d-8aee-4623-9ce7-fc3026329b9a. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-c2c8afc4-5223-447c-b0bc-a622de3699ec req-e31b4219-3365-42a4-8f92-e5c509ece936 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Updating instance_info_cache with network_info: [{"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2c8afc4-5223-447c-b0bc-a622de3699ec req-e31b4219-3365-42a4-8f92-e5c509ece936 service nova] Releasing lock "refresh_cache-84979ec3-09d4-4463-a20b-ca5dcf6986de" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-02a90e5e-ec17-4172-a5b4-8887cd41bae2 req-7e0d7ae8-9110-416d-b07d-1eaf1d8cc10c service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Updated VIF entry in instance network info cache for port a1fe3499-88a0-4b80-81a2-8d1a4da52b14. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-02a90e5e-ec17-4172-a5b4-8887cd41bae2 req-7e0d7ae8-9110-416d-b07d-1eaf1d8cc10c service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Updating instance_info_cache with network_info: [{"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02a90e5e-ec17-4172-a5b4-8887cd41bae2 req-7e0d7ae8-9110-416d-b07d-1eaf1d8cc10c service nova] Releasing lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:18:24 user nova-compute[74681]: INFO nova.compute.claims [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Claim successful on node user
Aug 16 06:18:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.network.neutron [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:18:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-bf1a9d89-83b6-47c3-8755-b39ba6929eba req-9211d545-321f-499d-a477-52c9140735d6 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received event network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bf1a9d89-83b6-47c3-8755-b39ba6929eba req-9211d545-321f-499d-a477-52c9140735d6 service nova] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bf1a9d89-83b6-47c3-8755-b39ba6929eba req-9211d545-321f-499d-a477-52c9140735d6 service nova] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bf1a9d89-83b6-47c3-8755-b39ba6929eba req-9211d545-321f-499d-a477-52c9140735d6 service nova] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-bf1a9d89-83b6-47c3-8755-b39ba6929eba req-9211d545-321f-499d-a477-52c9140735d6 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] No waiting events found dispatching network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:24 user nova-compute[74681]: WARNING nova.compute.manager [req-bf1a9d89-83b6-47c3-8755-b39ba6929eba req-9211d545-321f-499d-a477-52c9140735d6 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received unexpected event network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 for instance with vm_state building and task_state spawning.
Aug 16 06:18:25 user nova-compute[74681]: DEBUG nova.policy [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2525cd466cfb4097b91557bc3f41313a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f8c98f4c524a85bfca647755fd7d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:18:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Creating image(s)
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "/opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "/opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "/opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.216s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk 1073741824" returned: 0 in 0.073s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.245s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Successfully created port: b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:18:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Cannot resize image /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.objects.instance [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'migration_context' on Instance uuid a95646fe-8d93-47c7-9590-dbbb54c479d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Ensure instance console log exists: /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Successfully updated port: b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquired lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received event network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] No waiting events found dispatching network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:26 user nova-compute[74681]: WARNING nova.compute.manager [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received unexpected event network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 for instance with vm_state building and task_state spawning.
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-changed-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Refreshing instance network info cache due to event network-changed-b97e373d-1e74-46db-b24a-be1e723bd5ae. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] Acquiring lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166707.156136, ee235b33-937c-41f4-9052-fc7f9f200cbe => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:27 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] VM Resumed (Lifecycle Event)
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:18:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Instance spawned successfully.
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:27 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166707.1624632, ee235b33-937c-41f4-9052-fc7f9f200cbe => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:27 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] VM Started (Lifecycle Event)
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:28 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:18:28 user nova-compute[74681]: INFO nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Took 7.74 seconds to spawn the instance on the hypervisor.
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updating instance_info_cache with network_info: [{"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Releasing lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Instance network_info: |[{"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] Acquired lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Refreshing network info cache for port b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Start _get_guest_xml network_info=[{"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:18:28 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:28 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1692536432',display_name='tempest-TestStampPattern-server-1692536432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1692536432',id=24,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzoECm225ySl+HyAlmG0sv7wKoEPsgT9yAcs4kwnRa7sd0iBSZuzh0d16UZNUGe8zI0GmoGVsQ+b0UCPKJRw9yS1GVP40Wte/bTkaY2V6aoCUjPKx00k6FD7VMDRaRk9A==',key_name='tempest-TestStampPattern-1999912138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57f8c98f4c524a85bfca647755fd7d58',ramdisk_id='',reservation_id='r-26fjpj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-699262125',owner_user_name='tempest-TestStampPattern-699262125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:18:25Z,user_data=None,user_id='2525cd466cfb4097b91557bc3f41313a',uuid=a95646fe-8d93-47c7-9590-dbbb54c479d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converting VIF {"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f3:59,bridge_name='br-int',has_traffic_filtering=True,id=b97e373d-1e74-46db-b24a-be1e723bd5ae,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e373d-1e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.objects.instance [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'pci_devices' on Instance uuid a95646fe-8d93-47c7-9590-dbbb54c479d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:18:28 user nova-compute[74681]:   <uuid>a95646fe-8d93-47c7-9590-dbbb54c479d2</uuid>
Aug 16 06:18:28 user nova-compute[74681]:   <name>instance-00000018</name>
Aug 16 06:18:28 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:18:28 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:18:28 user nova-compute[74681]:   <metadata>
Aug 16 06:18:28 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:18:28 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:18:28 user nova-compute[74681]:       <nova:name>tempest-TestStampPattern-server-1692536432</nova:name>
Aug 16 06:18:28 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:18:27</nova:creationTime>
Aug 16 06:18:28 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:18:28 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:18:28 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:18:28 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:18:28 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:18:28 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:18:28 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:18:28 user nova-compute[74681]:       <nova:owner>
Aug 16 06:18:28 user nova-compute[74681]:         <nova:user uuid="2525cd466cfb4097b91557bc3f41313a">tempest-TestStampPattern-699262125-project-member</nova:user>
Aug 16 06:18:28 user nova-compute[74681]:         <nova:project uuid="57f8c98f4c524a85bfca647755fd7d58">tempest-TestStampPattern-699262125</nova:project>
Aug 16 06:18:28 user nova-compute[74681]:       </nova:owner>
Aug 16 06:18:28 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:18:28 user nova-compute[74681]:       <nova:ports>
Aug 16 06:18:28 user nova-compute[74681]:         <nova:port uuid="b97e373d-1e74-46db-b24a-be1e723bd5ae">
Aug 16 06:18:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 06:18:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:18:28 user nova-compute[74681]:       </nova:ports>
Aug 16 06:18:28 user nova-compute[74681]:     </nova:instance>
Aug 16 06:18:28 user nova-compute[74681]:   </metadata>
Aug 16 06:18:28 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:18:28 user nova-compute[74681]:     <system>
Aug 16 06:18:28 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:18:28 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:18:28 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:18:28 user nova-compute[74681]:       <entry name="serial">a95646fe-8d93-47c7-9590-dbbb54c479d2</entry>
Aug 16 06:18:28 user nova-compute[74681]:       <entry name="uuid">a95646fe-8d93-47c7-9590-dbbb54c479d2</entry>
Aug 16 06:18:28 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:18:28 user nova-compute[74681]:     </system>
Aug 16 06:18:28 user nova-compute[74681]:   </sysinfo>
Aug 16 06:18:28 user nova-compute[74681]:   <os>
Aug 16 06:18:28 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:18:28 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:18:28 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:18:28 user nova-compute[74681]:   </os>
Aug 16 06:18:28 user nova-compute[74681]:   <features>
Aug 16 06:18:28 user nova-compute[74681]:     <acpi/>
Aug 16 06:18:28 user nova-compute[74681]:     <apic/>
Aug 16 06:18:28 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:18:28 user nova-compute[74681]:   </features>
Aug 16 06:18:28 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:18:28 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:18:28 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:18:28 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:18:28 user nova-compute[74681]:   </clock>
Aug 16 06:18:28 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:18:28 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:18:28 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:18:28 user nova-compute[74681]:   </cpu>
Aug 16 06:18:28 user nova-compute[74681]:   <devices>
Aug 16 06:18:28 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:18:28 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:18:28 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk"/>
Aug 16 06:18:28 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:18:28 user nova-compute[74681]:     </disk>
Aug 16 06:18:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:18:28 user nova-compute[74681]:       <mac address="fa:16:3e:ec:f3:59"/>
Aug 16 06:18:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:18:28 user nova-compute[74681]:       <target dev="tapb97e373d-1e"/>
Aug 16 06:18:28 user nova-compute[74681]:     </interface>
Aug 16 06:18:28 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:18:28 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/console.log" append="off"/>
Aug 16 06:18:28 user nova-compute[74681]:     </serial>
Aug 16 06:18:28 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:18:28 user nova-compute[74681]:     <video>
Aug 16 06:18:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:28 user nova-compute[74681]:     </video>
Aug 16 06:18:28 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:18:28 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:18:28 user nova-compute[74681]:     </rng>
Aug 16 06:18:28 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:18:28 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:18:28 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:18:28 user nova-compute[74681]:     </memballoon>
Aug 16 06:18:28 user nova-compute[74681]:   </devices>
Aug 16 06:18:28 user nova-compute[74681]: </domain>
Aug 16 06:18:28 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1692536432',display_name='tempest-TestStampPattern-server-1692536432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1692536432',id=24,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzoECm225ySl+HyAlmG0sv7wKoEPsgT9yAcs4kwnRa7sd0iBSZuzh0d16UZNUGe8zI0GmoGVsQ+b0UCPKJRw9yS1GVP40Wte/bTkaY2V6aoCUjPKx00k6FD7VMDRaRk9A==',key_name='tempest-TestStampPattern-1999912138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57f8c98f4c524a85bfca647755fd7d58',ramdisk_id='',reservation_id='r-26fjpj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-699262125',owner_user_name='tempest-TestStampPattern-699262125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:18:25Z,user_data=None,user_id='2525cd466cfb4097b91557bc3f41313a',uuid=a95646fe-8d93-47c7-9590-dbbb54c479d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converting VIF {"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f3:59,bridge_name='br-int',has_traffic_filtering=True,id=b97e373d-1e74-46db-b24a-be1e723bd5ae,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e373d-1e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG os_vif [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f3:59,bridge_name='br-int',has_traffic_filtering=True,id=b97e373d-1e74-46db-b24a-be1e723bd5ae,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e373d-1e') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb97e373d-1e, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb97e373d-1e, col_values=(('external_ids', {'iface-id': 'b97e373d-1e74-46db-b24a-be1e723bd5ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:f3:59', 'vm-uuid': 'a95646fe-8d93-47c7-9590-dbbb54c479d2'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:28 user nova-compute[74681]: INFO os_vif [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f3:59,bridge_name='br-int',has_traffic_filtering=True,id=b97e373d-1e74-46db-b24a-be1e723bd5ae,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e373d-1e')
Aug 16 06:18:28 user nova-compute[74681]: INFO nova.compute.manager [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Took 10.02 seconds to build instance.
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updated VIF entry in instance network info cache for port b97e373d-1e74-46db-b24a-be1e723bd5ae. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updating instance_info_cache with network_info: [{"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce98d882-d7e7-45db-9cd7-6be94a8fa36c req-4875d632-d301-4b6d-bea2-50e7ef6a1f40 service nova] Releasing lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-98ba8092-f22b-4fc0-a261-31ddae94506c tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.370s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:18:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No VIF found with MAC fa:16:3e:ec:f3:59, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 84979ec3-09d4-4463-a20b-ca5dcf6986de {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-941f3203-09a8-4c05-b69d-f3cab56e1f67 req-8bd86a10-82b5-4bf0-9ea2-03c477072d9b service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-941f3203-09a8-4c05-b69d-f3cab56e1f67 req-8bd86a10-82b5-4bf0-9ea2-03c477072d9b service nova] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-941f3203-09a8-4c05-b69d-f3cab56e1f67 req-8bd86a10-82b5-4bf0-9ea2-03c477072d9b service nova] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-941f3203-09a8-4c05-b69d-f3cab56e1f67 req-8bd86a10-82b5-4bf0-9ea2-03c477072d9b service nova] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-941f3203-09a8-4c05-b69d-f3cab56e1f67 req-8bd86a10-82b5-4bf0-9ea2-03c477072d9b service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] No waiting events found dispatching network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:30 user nova-compute[74681]: WARNING nova.compute.manager [req-941f3203-09a8-4c05-b69d-f3cab56e1f67 req-8bd86a10-82b5-4bf0-9ea2-03c477072d9b service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received unexpected event network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae for instance with vm_state building and task_state spawning.
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:30 user nova-compute[74681]: INFO nova.compute.manager [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Attaching volume 005ac6ce-df18-4df6-9f8f-044f7aa5c95c to /dev/vdb
Aug 16 06:18:30 user nova-compute[74681]: DEBUG os_brick.utils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e296638-8176-4dd4-a433-916bf262bf46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be633c5-e9ff-4ece-8af2-1975a3040120]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[95662005-3630-4b61-9e21-23241bcef278]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31c8708-1370-4b7a-83c3-45d32359ab80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:18:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:18:31 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:18:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecce1b7-ebc0-455c-8e71-f755b2a56765]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:18:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:18:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:18:31 user nova-compute[74681]: DEBUG os_brick.utils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:18:31 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Updating existing volume attachment record: 8304f213-a6e8-461a-af2b-973e37050d6e {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-37df50ae-e4f7-4b46-9af4-d26a3a0bc73c req-c946204f-6cf0-41df-86bf-afe8dce4bd5c service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-37df50ae-e4f7-4b46-9af4-d26a3a0bc73c req-c946204f-6cf0-41df-86bf-afe8dce4bd5c service nova] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-37df50ae-e4f7-4b46-9af4-d26a3a0bc73c req-c946204f-6cf0-41df-86bf-afe8dce4bd5c service nova] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-37df50ae-e4f7-4b46-9af4-d26a3a0bc73c req-c946204f-6cf0-41df-86bf-afe8dce4bd5c service nova] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-37df50ae-e4f7-4b46-9af4-d26a3a0bc73c req-c946204f-6cf0-41df-86bf-afe8dce4bd5c service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] No waiting events found dispatching network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:32 user nova-compute[74681]: WARNING nova.compute.manager [req-37df50ae-e4f7-4b46-9af4-d26a3a0bc73c req-c946204f-6cf0-41df-86bf-afe8dce4bd5c service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received unexpected event network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae for instance with vm_state building and task_state spawning.
Aug 16 06:18:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166712.7760649, a95646fe-8d93-47c7-9590-dbbb54c479d2 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] VM Resumed (Lifecycle Event)
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:18:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Instance spawned successfully.
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166712.777774, a95646fe-8d93-47c7-9590-dbbb54c479d2 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] VM Started (Lifecycle Event)
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:18:32 user nova-compute[74681]: INFO nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Took 7.89 seconds to spawn the instance on the hypervisor.
Aug 16 06:18:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:33 user nova-compute[74681]: INFO nova.compute.manager [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Took 8.99 seconds to build instance.
Aug 16 06:18:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-08ab9d7a-c83a-47bb-97d5-d86a9b7ecfb6 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.197s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:35 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:18:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:35 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:18:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updating instance_info_cache with network_info: [{"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-e7e44f1a-d07e-4b37-bed0-9cf141649d6d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:18:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:41 user nova-compute[74681]: INFO nova.compute.manager [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Terminating instance
Aug 16 06:18:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-e0350718-e47b-40dd-b4d2-cb51966a5081 req-ca9191ce-5b3b-4298-909d-22be5d0d60ed service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received event network-vif-unplugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e0350718-e47b-40dd-b4d2-cb51966a5081 req-ca9191ce-5b3b-4298-909d-22be5d0d60ed service nova] Acquiring lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e0350718-e47b-40dd-b4d2-cb51966a5081 req-ca9191ce-5b3b-4298-909d-22be5d0d60ed service nova] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e0350718-e47b-40dd-b4d2-cb51966a5081 req-ca9191ce-5b3b-4298-909d-22be5d0d60ed service nova] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-e0350718-e47b-40dd-b4d2-cb51966a5081 req-ca9191ce-5b3b-4298-909d-22be5d0d60ed service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] No waiting events found dispatching network-vif-unplugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-e0350718-e47b-40dd-b4d2-cb51966a5081 req-ca9191ce-5b3b-4298-909d-22be5d0d60ed service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received event network-vif-unplugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:42 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Instance destroyed successfully.
Aug 16 06:18:42 user nova-compute[74681]: DEBUG nova.objects.instance [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lazy-loading 'resources' on Instance uuid 02e364f9-af4e-40bb-a0b4-2b1864f54270 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:09:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-458531903',display_name='tempest-ServersNegativeTestJSON-server-458531903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-458531903',id=1,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c4497e1bbb04a6badebffb1fe54b82a',ramdisk_id='',reservation_id='r-wm026m32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1958763636',owner_user_name='tempest-ServersNegativeTestJSON-1958763636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:10:02Z,user_data=None,user_id='9f41156e5aac4c49b8d79b28fe9759d9',uuid=02e364f9-af4e-40bb-a0b4-2b1864f54270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converting VIF {"id": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "address": "fa:16:3e:79:0f:bc", "network": {"id": "cc0a82cc-30bc-4748-8693-53d4bdb44b04", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2129953019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4497e1bbb04a6badebffb1fe54b82a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88cb26c3-de", "ovs_interfaceid": "88cb26c3-ded5-42e9-83a4-8f3c66726dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=88cb26c3-ded5-42e9-83a4-8f3c66726dfd,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88cb26c3-de') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG os_vif [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=88cb26c3-ded5-42e9-83a4-8f3c66726dfd,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88cb26c3-de') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88cb26c3-de, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:18:42 user nova-compute[74681]: INFO os_vif [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:0f:bc,bridge_name='br-int',has_traffic_filtering=True,id=88cb26c3-ded5-42e9-83a4-8f3c66726dfd,network=Network(cc0a82cc-30bc-4748-8693-53d4bdb44b04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88cb26c3-de')
Aug 16 06:18:42 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Deleting instance files /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270_del
Aug 16 06:18:42 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Deletion of /opt/stack/data/nova/instances/02e364f9-af4e-40bb-a0b4-2b1864f54270_del complete
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:42 user nova-compute[74681]: INFO nova.compute.manager [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:18:42 user nova-compute[74681]: INFO nova.compute.claims [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Claim successful on node user
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-8be24d2a-5cf7-44e6-8433-761914b84623 req-30c45b17-2038-4b70-aac4-d8902e284bbc service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received event network-vif-deleted-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:43 user nova-compute[74681]: INFO nova.compute.manager [req-8be24d2a-5cf7-44e6-8433-761914b84623 req-30c45b17-2038-4b70-aac4-d8902e284bbc service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Neutron deleted interface 88cb26c3-ded5-42e9-83a4-8f3c66726dfd; detaching it from the instance and deleting it from the info cache
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-8be24d2a-5cf7-44e6-8433-761914b84623 req-30c45b17-2038-4b70-aac4-d8902e284bbc service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Took 0.81 seconds to deallocate network for instance.
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-8be24d2a-5cf7-44e6-8433-761914b84623 req-30c45b17-2038-4b70-aac4-d8902e284bbc service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Detach interface failed, port_id=88cb26c3-ded5-42e9-83a4-8f3c66726dfd, reason: Instance 02e364f9-af4e-40bb-a0b4-2b1864f54270 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeOKUwtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:18:43 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:18:43 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:18:43 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b054cdd-b507-45e1-9f9b-13ae365a1d31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:18:43 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fef87c0-3ea1-4352-8ca2-6a8b6a547ea2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c] added
Aug 16 06:18:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05537b-8ec2-461f-98ed-9026d0b0c883]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.055s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.169s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e673afa-42eb-4983-98dc-1ffe1a20d866]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeOKUwtk {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeOKUwtk" returned: 0 in 0.116s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce31b1b-b8b7-4d2a-8ea6-5287f38ef126]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeOKUwtk'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b3496-f741-4fd6-a630-7b7a11c277bd]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ff2b09-73c1-4cf7-b511-36b764c7dbb0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:18:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:18:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0283f120-64c5-4de8-8937-58c499641eed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c, portal: 172.16.0.220,3260]
Aug 16 06:18:43 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c, portal: 172.16.0.220,3260] successful.
Aug 16 06:18:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a77da4-d2f2-40d2-b828-5a8a0c7222c9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-5350fe4f-3d40-492c-a70b-fd78009ceffc req-b88ac0dc-6b57-41ed-8b46-c00eee827003 service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received event network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5350fe4f-3d40-492c-a70b-fd78009ceffc req-b88ac0dc-6b57-41ed-8b46-c00eee827003 service nova] Acquiring lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5350fe4f-3d40-492c-a70b-fd78009ceffc req-b88ac0dc-6b57-41ed-8b46-c00eee827003 service nova] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5350fe4f-3d40-492c-a70b-fd78009ceffc req-b88ac0dc-6b57-41ed-8b46-c00eee827003 service nova] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-5350fe4f-3d40-492c-a70b-fd78009ceffc req-b88ac0dc-6b57-41ed-8b46-c00eee827003 service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] No waiting events found dispatching network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:44 user nova-compute[74681]: WARNING nova.compute.manager [req-5350fe4f-3d40-492c-a70b-fd78009ceffc req-b88ac0dc-6b57-41ed-8b46-c00eee827003 service nova] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Received unexpected event network-vif-plugged-88cb26c3-ded5-42e9-83a4-8f3c66726dfd for instance with vm_state deleted and task_state None.
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG nova.policy [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '790c60ee58a549ddaabd5f0badcb77fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845526507c1a4a9eadc6c45271cceb94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d507fae-ddfa-4231-a3d0-8912a00fd864]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:18:44 user nova-compute[74681]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c (non-flash)
Aug 16 06:18:44 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:18:44 user nova-compute[74681]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c (non-flash)
Aug 16 06:18:44 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.662s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.047s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2937117-b8db-4eea-b631-87dade47dd9e]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:18:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Creating image(s)
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.052s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.854s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.239s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Deleted allocations for instance 02e364f9-af4e-40bb-a0b4-2b1864f54270
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-488915f9-5831-49c0-9911-8ca46890844e tempest-ServersNegativeTestJSON-1958763636 tempest-ServersNegativeTestJSON-1958763636-project-member] Lock "02e364f9-af4e-40bb-a0b4-2b1864f54270" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.240s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk 1073741824" returned: 0 in 0.062s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:44 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid '02e364f9-af4e-40bb-a0b4-2b1864f54270' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid '02e364f9-af4e-40bb-a0b4-2b1864f54270' (instance-00000001)
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.238s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeOKUwtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.742s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== connect_volume: return (1744ms) {'type': 'block', 'scsi_wwn': '26334623563313135', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334623563313135', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 84979ec3-09d4-4463-a20b-ca5dcf6986de {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Successfully created port: a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:18:45 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:18:45 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:18:45 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:18:45 user nova-compute[74681]:   <serial>005ac6ce-df18-4df6-9f8f-044f7aa5c95c</serial>
Aug 16 06:18:45 user nova-compute[74681]: </disk>
Aug 16 06:18:45 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Cannot resize image /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'migration_context' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Ensure instance console log exists: /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7312MB free_disk=25.57715606689453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No VIF found with MAC fa:16:3e:7b:20:f7, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Successfully updated port: a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquired lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-c23af395-d422-4fe4-8b6a-3dca6610b61d req-3dc9e8a6-29f6-4af8-a789-4ba740813097 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-changed-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-c23af395-d422-4fe4-8b6a-3dca6610b61d req-3dc9e8a6-29f6-4af8-a789-4ba740813097 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Refreshing instance network info cache due to event network-changed-a2b31ee4-02ef-4ce4-87a1-8901f392593f. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c23af395-d422-4fe4-8b6a-3dca6610b61d req-3dc9e8a6-29f6-4af8-a789-4ba740813097 service nova] Acquiring lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance e7e44f1a-d07e-4b37-bed0-9cf141649d6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 84979ec3-09d4-4463-a20b-ca5dcf6986de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 20509fce-ff8d-4edc-85e9-c54375c274da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ee235b33-937c-41f4-9052-fc7f9f200cbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a95646fe-8d93-47c7-9590-dbbb54c479d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-45748168-5d15-4f8e-9f2e-b5a90225453d tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.889s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:18:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updating instance_info_cache with network_info: [{"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Releasing lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance network_info: |[{"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c23af395-d422-4fe4-8b6a-3dca6610b61d req-3dc9e8a6-29f6-4af8-a789-4ba740813097 service nova] Acquired lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-c23af395-d422-4fe4-8b6a-3dca6610b61d req-3dc9e8a6-29f6-4af8-a789-4ba740813097 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Refreshing network info cache for port a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Start _get_guest_xml network_info=[{"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:18:47 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:47 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1387190709',display_name='tempest-tempest.common.compute-instance-1387190709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1387190709',id=25,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2L1ejR2vei5TDJOZbHSyBoxvQApT2+jkpRVZD90oKBxXOM2q1a3wTMe8Xu++AP0SDOe2Xi6a1YzF+6WIWoDKCBaZimySH7babwXR4TOSdLQ/i0QpfzTRR+mACQj56FfQ==',key_name='tempest-keypair-780374784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-73tkjm38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:18:47 user nova-compute[74681]:   <uuid>6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7</uuid>
Aug 16 06:18:47 user nova-compute[74681]:   <name>instance-00000019</name>
Aug 16 06:18:47 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:18:47 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:18:47 user nova-compute[74681]:   <metadata>
Aug 16 06:18:47 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:18:47 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:18:47 user nova-compute[74681]:       <nova:name>tempest-tempest.common.compute-instance-1387190709</nova:name>
Aug 16 06:18:47 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:18:47</nova:creationTime>
Aug 16 06:18:47 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:18:47 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:18:47 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:18:47 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:18:47 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:18:47 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:18:47 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:18:47 user nova-compute[74681]:       <nova:owner>
Aug 16 06:18:47 user nova-compute[74681]:         <nova:user uuid="790c60ee58a549ddaabd5f0badcb77fe">tempest-ServerActionsTestOtherA-2037182259-project-member</nova:user>
Aug 16 06:18:47 user nova-compute[74681]:         <nova:project uuid="845526507c1a4a9eadc6c45271cceb94">tempest-ServerActionsTestOtherA-2037182259</nova:project>
Aug 16 06:18:47 user nova-compute[74681]:       </nova:owner>
Aug 16 06:18:47 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:18:47 user nova-compute[74681]:       <nova:ports>
Aug 16 06:18:47 user nova-compute[74681]:         <nova:port uuid="a2b31ee4-02ef-4ce4-87a1-8901f392593f">
Aug 16 06:18:47 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 06:18:47 user nova-compute[74681]:         </nova:port>
Aug 16 06:18:47 user nova-compute[74681]:       </nova:ports>
Aug 16 06:18:47 user nova-compute[74681]:     </nova:instance>
Aug 16 06:18:47 user nova-compute[74681]:   </metadata>
Aug 16 06:18:47 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:18:47 user nova-compute[74681]:     <system>
Aug 16 06:18:47 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:18:47 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:18:47 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:18:47 user nova-compute[74681]:       <entry name="serial">6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7</entry>
Aug 16 06:18:47 user nova-compute[74681]:       <entry name="uuid">6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7</entry>
Aug 16 06:18:47 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:18:47 user nova-compute[74681]:     </system>
Aug 16 06:18:47 user nova-compute[74681]:   </sysinfo>
Aug 16 06:18:47 user nova-compute[74681]:   <os>
Aug 16 06:18:47 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:18:47 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:18:47 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:18:47 user nova-compute[74681]:   </os>
Aug 16 06:18:47 user nova-compute[74681]:   <features>
Aug 16 06:18:47 user nova-compute[74681]:     <acpi/>
Aug 16 06:18:47 user nova-compute[74681]:     <apic/>
Aug 16 06:18:47 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:18:47 user nova-compute[74681]:   </features>
Aug 16 06:18:47 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:18:47 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:18:47 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:18:47 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:18:47 user nova-compute[74681]:   </clock>
Aug 16 06:18:47 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:18:47 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:18:47 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:18:47 user nova-compute[74681]:   </cpu>
Aug 16 06:18:47 user nova-compute[74681]:   <devices>
Aug 16 06:18:47 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:18:47 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:18:47 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk"/>
Aug 16 06:18:47 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:18:47 user nova-compute[74681]:     </disk>
Aug 16 06:18:47 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:18:47 user nova-compute[74681]:       <mac address="fa:16:3e:c6:c6:78"/>
Aug 16 06:18:47 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:47 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:18:47 user nova-compute[74681]:       <target dev="tapa2b31ee4-02"/>
Aug 16 06:18:47 user nova-compute[74681]:     </interface>
Aug 16 06:18:47 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:18:47 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/console.log" append="off"/>
Aug 16 06:18:47 user nova-compute[74681]:     </serial>
Aug 16 06:18:47 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:18:47 user nova-compute[74681]:     <video>
Aug 16 06:18:47 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:47 user nova-compute[74681]:     </video>
Aug 16 06:18:47 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:18:47 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:18:47 user nova-compute[74681]:     </rng>
Aug 16 06:18:47 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:18:47 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:18:47 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:18:47 user nova-compute[74681]:     </memballoon>
Aug 16 06:18:47 user nova-compute[74681]:   </devices>
Aug 16 06:18:47 user nova-compute[74681]: </domain>
Aug 16 06:18:47 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1387190709',display_name='tempest-tempest.common.compute-instance-1387190709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1387190709',id=25,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2L1ejR2vei5TDJOZbHSyBoxvQApT2+jkpRVZD90oKBxXOM2q1a3wTMe8Xu++AP0SDOe2Xi6a1YzF+6WIWoDKCBaZimySH7babwXR4TOSdLQ/i0QpfzTRR+mACQj56FfQ==',key_name='tempest-keypair-780374784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-73tkjm38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG os_vif [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2b31ee4-02, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2b31ee4-02, col_values=(('external_ids', {'iface-id': 'a2b31ee4-02ef-4ce4-87a1-8901f392593f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:c6:78', 'vm-uuid': '6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:47 user nova-compute[74681]: INFO os_vif [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02')
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No VIF found with MAC fa:16:3e:c6:c6:78, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-c23af395-d422-4fe4-8b6a-3dca6610b61d req-3dc9e8a6-29f6-4af8-a789-4ba740813097 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updated VIF entry in instance network info cache for port a2b31ee4-02ef-4ce4-87a1-8901f392593f. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-c23af395-d422-4fe4-8b6a-3dca6610b61d req-3dc9e8a6-29f6-4af8-a789-4ba740813097 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updating instance_info_cache with network_info: [{"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c23af395-d422-4fe4-8b6a-3dca6610b61d req-3dc9e8a6-29f6-4af8-a789-4ba740813097 service nova] Releasing lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:47 user nova-compute[74681]: INFO nova.compute.manager [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Detaching volume 005ac6ce-df18-4df6-9f8f-044f7aa5c95c
Aug 16 06:18:48 user nova-compute[74681]: INFO nova.virt.block_device [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Attempting to driver detach volume 005ac6ce-df18-4df6-9f8f-044f7aa5c95c from mountpoint /dev/vdb
Aug 16 06:18:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Attempting to detach device vdb from instance 84979ec3-09d4-4463-a20b-ca5dcf6986de from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:18:48 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:18:48 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:18:48 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:18:48 user nova-compute[74681]:   <serial>005ac6ce-df18-4df6-9f8f-044f7aa5c95c</serial>
Aug 16 06:18:48 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:18:48 user nova-compute[74681]: </disk>
Aug 16 06:18:48 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:18:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully detached device vdb from instance 84979ec3-09d4-4463-a20b-ca5dcf6986de from the persistent domain config.
Aug 16 06:18:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84979ec3-09d4-4463-a20b-ca5dcf6986de from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:18:48 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:18:48 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:18:48 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:18:48 user nova-compute[74681]:   <serial>005ac6ce-df18-4df6-9f8f-044f7aa5c95c</serial>
Aug 16 06:18:48 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:18:48 user nova-compute[74681]: </disk>
Aug 16 06:18:48 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "9662557e-2e89-42a0-9f0d-2189f84eece6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:18:48 user nova-compute[74681]: INFO nova.compute.claims [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Claim successful on node user
Aug 16 06:18:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-cc050f84-c6d6-4939-8bc2-b388a48f9764 req-3fc89ea6-66e6-4043-9913-43a4c13bccc6 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cc050f84-c6d6-4939-8bc2-b388a48f9764 req-3fc89ea6-66e6-4043-9913-43a4c13bccc6 service nova] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cc050f84-c6d6-4939-8bc2-b388a48f9764 req-3fc89ea6-66e6-4043-9913-43a4c13bccc6 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cc050f84-c6d6-4939-8bc2-b388a48f9764 req-3fc89ea6-66e6-4043-9913-43a4c13bccc6 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-cc050f84-c6d6-4939-8bc2-b388a48f9764 req-3fc89ea6-66e6-4043-9913-43a4c13bccc6 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] No waiting events found dispatching network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:48 user nova-compute[74681]: WARNING nova.compute.manager [req-cc050f84-c6d6-4939-8bc2-b388a48f9764 req-3fc89ea6-66e6-4043-9913-43a4c13bccc6 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received unexpected event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f for instance with vm_state building and task_state spawning.
Aug 16 06:18:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166729.0227175, 84979ec3-09d4-4463-a20b-ca5dcf6986de => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84979ec3-09d4-4463-a20b-ca5dcf6986de {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:18:49 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully detached device vdb from instance 84979ec3-09d4-4463-a20b-ca5dcf6986de from the live domain config.
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeOKUwtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:18:49 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d9243-cfe8-407a-8c5f-485039e7d233]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f858db-8ce3-4fc8-819d-93f22127e0b8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:18:49 user nova-compute[74681]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c (non-flash)
Aug 16 06:18:49 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:18:49 user nova-compute[74681]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c (non-flash)
Aug 16 06:18:49 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9484288820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[52960cc9-bfd7-4ba9-883e-d6ba2a36d3ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f5c859-3011-417b-9730-9d695fcd700c]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6581f26f-c57c-4c86-bf8f-7dd959a82a42]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca69a52-fce9-4f43-a535-62fc54b3d6f7]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e9f2c8-d37c-46e6-8214-5778a0608d1a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf583e9e-f9a5-40d2-b2fe-5d6a57500d96]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c, portal: 172.16.0.220,3260]
Aug 16 06:18:49 user nova-compute[74681]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c, portal: 172.16.0.220,3260] successful.
Aug 16 06:18:49 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.policy [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '597807248b8f4c598235cf07b48d1de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1f3324efa34f56bab9b32dff44ac74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:005ac6ce-df18-4df6-9f8f-044f7aa5c95c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef36e13-7b1c-4d4f-be99-64be1d38e6dd]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== disconnect_volume: return (341ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:18:49 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Creating image(s)
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "/opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "/opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "/opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk 1073741824" returned: 0 in 0.093s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Successfully created port: 256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Cannot resize image /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lazy-loading 'migration_context' on Instance uuid 9662557e-2e89-42a0-9f0d-2189f84eece6 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 84979ec3-09d4-4463-a20b-ca5dcf6986de {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Ensure instance console log exists: /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ffec4bf2-62c5-4914-a2c4-fecda9ae692b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.358s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-8971293d-098e-4e4b-b585-d5f98d414b06 req-4a18d756-3231-4f33-b3cb-9ca17f8d7a11 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8971293d-098e-4e4b-b585-d5f98d414b06 req-4a18d756-3231-4f33-b3cb-9ca17f8d7a11 service nova] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8971293d-098e-4e4b-b585-d5f98d414b06 req-4a18d756-3231-4f33-b3cb-9ca17f8d7a11 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8971293d-098e-4e4b-b585-d5f98d414b06 req-4a18d756-3231-4f33-b3cb-9ca17f8d7a11 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-8971293d-098e-4e4b-b585-d5f98d414b06 req-4a18d756-3231-4f33-b3cb-9ca17f8d7a11 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] No waiting events found dispatching network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:51 user nova-compute[74681]: WARNING nova.compute.manager [req-8971293d-098e-4e4b-b585-d5f98d414b06 req-4a18d756-3231-4f33-b3cb-9ca17f8d7a11 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received unexpected event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f for instance with vm_state building and task_state spawning.
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Successfully updated port: 256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "refresh_cache-9662557e-2e89-42a0-9f0d-2189f84eece6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquired lock "refresh_cache-9662557e-2e89-42a0-9f0d-2189f84eece6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-f773babb-ab2c-4de7-a7fc-181bd3f9d0a4 req-6c35191e-eeb3-48c8-a7fb-874216d85484 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received event network-changed-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-f773babb-ab2c-4de7-a7fc-181bd3f9d0a4 req-6c35191e-eeb3-48c8-a7fb-874216d85484 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Refreshing instance network info cache due to event network-changed-256a200b-7264-4f81-803d-5d48e6156734. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f773babb-ab2c-4de7-a7fc-181bd3f9d0a4 req-6c35191e-eeb3-48c8-a7fb-874216d85484 service nova] Acquiring lock "refresh_cache-9662557e-2e89-42a0-9f0d-2189f84eece6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166731.3265922, 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] VM Resumed (Lifecycle Event)
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:18:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance spawned successfully.
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166731.3268945, 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] VM Started (Lifecycle Event)
Aug 16 06:18:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Took 7.25 seconds to spawn the instance on the hypervisor.
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:18:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Took 9.03 seconds to build instance.
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0984fbf0-da6d-4de6-89a2-3ea6d9a52545 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.213s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.neutron [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Updating instance_info_cache with network_info: [{"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Releasing lock "refresh_cache-9662557e-2e89-42a0-9f0d-2189f84eece6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Instance network_info: |[{"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f773babb-ab2c-4de7-a7fc-181bd3f9d0a4 req-6c35191e-eeb3-48c8-a7fb-874216d85484 service nova] Acquired lock "refresh_cache-9662557e-2e89-42a0-9f0d-2189f84eece6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.neutron [req-f773babb-ab2c-4de7-a7fc-181bd3f9d0a4 req-6c35191e-eeb3-48c8-a7fb-874216d85484 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Refreshing network info cache for port 256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Start _get_guest_xml network_info=[{"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:18:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-633812485',display_name='tempest-VolumesActionsTest-instance-633812485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-633812485',id=26,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b1f3324efa34f56bab9b32dff44ac74',ramdisk_id='',reservation_id='r-i9sp18g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-13411155',owner_user_name='tempest-VolumesActionsTest-13411155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:18:49Z,user_data=None,user_id='597807248b8f4c598235cf07b48d1de5',uuid=9662557e-2e89-42a0-9f0d-2189f84eece6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converting VIF {"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=256a200b-7264-4f81-803d-5d48e6156734,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256a200b-72') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lazy-loading 'pci_devices' on Instance uuid 9662557e-2e89-42a0-9f0d-2189f84eece6 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:18:51 user nova-compute[74681]:   <uuid>9662557e-2e89-42a0-9f0d-2189f84eece6</uuid>
Aug 16 06:18:51 user nova-compute[74681]:   <name>instance-0000001a</name>
Aug 16 06:18:51 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:18:51 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:18:51 user nova-compute[74681]:   <metadata>
Aug 16 06:18:51 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:18:51 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:18:51 user nova-compute[74681]:       <nova:name>tempest-VolumesActionsTest-instance-633812485</nova:name>
Aug 16 06:18:51 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:18:51</nova:creationTime>
Aug 16 06:18:51 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:18:51 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:18:51 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:18:51 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:18:51 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:18:51 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:18:51 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:18:51 user nova-compute[74681]:       <nova:owner>
Aug 16 06:18:51 user nova-compute[74681]:         <nova:user uuid="597807248b8f4c598235cf07b48d1de5">tempest-VolumesActionsTest-13411155-project-member</nova:user>
Aug 16 06:18:51 user nova-compute[74681]:         <nova:project uuid="9b1f3324efa34f56bab9b32dff44ac74">tempest-VolumesActionsTest-13411155</nova:project>
Aug 16 06:18:51 user nova-compute[74681]:       </nova:owner>
Aug 16 06:18:51 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:18:51 user nova-compute[74681]:       <nova:ports>
Aug 16 06:18:51 user nova-compute[74681]:         <nova:port uuid="256a200b-7264-4f81-803d-5d48e6156734">
Aug 16 06:18:51 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 06:18:51 user nova-compute[74681]:         </nova:port>
Aug 16 06:18:51 user nova-compute[74681]:       </nova:ports>
Aug 16 06:18:51 user nova-compute[74681]:     </nova:instance>
Aug 16 06:18:51 user nova-compute[74681]:   </metadata>
Aug 16 06:18:51 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:18:51 user nova-compute[74681]:     <system>
Aug 16 06:18:51 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:18:51 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:18:51 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:18:51 user nova-compute[74681]:       <entry name="serial">9662557e-2e89-42a0-9f0d-2189f84eece6</entry>
Aug 16 06:18:51 user nova-compute[74681]:       <entry name="uuid">9662557e-2e89-42a0-9f0d-2189f84eece6</entry>
Aug 16 06:18:51 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:18:51 user nova-compute[74681]:     </system>
Aug 16 06:18:51 user nova-compute[74681]:   </sysinfo>
Aug 16 06:18:51 user nova-compute[74681]:   <os>
Aug 16 06:18:51 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:18:51 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:18:51 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:18:51 user nova-compute[74681]:   </os>
Aug 16 06:18:51 user nova-compute[74681]:   <features>
Aug 16 06:18:51 user nova-compute[74681]:     <acpi/>
Aug 16 06:18:51 user nova-compute[74681]:     <apic/>
Aug 16 06:18:51 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:18:51 user nova-compute[74681]:   </features>
Aug 16 06:18:51 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:18:51 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:18:51 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:18:51 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:18:51 user nova-compute[74681]:   </clock>
Aug 16 06:18:51 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:18:51 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:18:51 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:18:51 user nova-compute[74681]:   </cpu>
Aug 16 06:18:51 user nova-compute[74681]:   <devices>
Aug 16 06:18:51 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:18:51 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:18:51 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk"/>
Aug 16 06:18:51 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:18:51 user nova-compute[74681]:     </disk>
Aug 16 06:18:51 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:18:51 user nova-compute[74681]:       <mac address="fa:16:3e:83:66:a0"/>
Aug 16 06:18:51 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:51 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:18:51 user nova-compute[74681]:       <target dev="tap256a200b-72"/>
Aug 16 06:18:51 user nova-compute[74681]:     </interface>
Aug 16 06:18:51 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:18:51 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/console.log" append="off"/>
Aug 16 06:18:51 user nova-compute[74681]:     </serial>
Aug 16 06:18:51 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:18:51 user nova-compute[74681]:     <video>
Aug 16 06:18:51 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:18:51 user nova-compute[74681]:     </video>
Aug 16 06:18:51 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:18:51 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:18:51 user nova-compute[74681]:     </rng>
Aug 16 06:18:51 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:18:51 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:18:51 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:18:51 user nova-compute[74681]:     </memballoon>
Aug 16 06:18:51 user nova-compute[74681]:   </devices>
Aug 16 06:18:51 user nova-compute[74681]: </domain>
Aug 16 06:18:51 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-633812485',display_name='tempest-VolumesActionsTest-instance-633812485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-633812485',id=26,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b1f3324efa34f56bab9b32dff44ac74',ramdisk_id='',reservation_id='r-i9sp18g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-13411155',owner_user_name='tempest-VolumesActionsTest-13411155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:18:49Z,user_data=None,user_id='597807248b8f4c598235cf07b48d1de5',uuid=9662557e-2e89-42a0-9f0d-2189f84eece6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converting VIF {"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=256a200b-7264-4f81-803d-5d48e6156734,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256a200b-72') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG os_vif [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=256a200b-7264-4f81-803d-5d48e6156734,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256a200b-72') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap256a200b-72, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap256a200b-72, col_values=(('external_ids', {'iface-id': '256a200b-7264-4f81-803d-5d48e6156734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:66:a0', 'vm-uuid': '9662557e-2e89-42a0-9f0d-2189f84eece6'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:51 user nova-compute[74681]: INFO os_vif [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=256a200b-7264-4f81-803d-5d48e6156734,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256a200b-72')
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:18:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] No VIF found with MAC fa:16:3e:83:66:a0, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:18:52 user nova-compute[74681]: DEBUG nova.network.neutron [req-f773babb-ab2c-4de7-a7fc-181bd3f9d0a4 req-6c35191e-eeb3-48c8-a7fb-874216d85484 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Updated VIF entry in instance network info cache for port 256a200b-7264-4f81-803d-5d48e6156734. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:18:52 user nova-compute[74681]: DEBUG nova.network.neutron [req-f773babb-ab2c-4de7-a7fc-181bd3f9d0a4 req-6c35191e-eeb3-48c8-a7fb-874216d85484 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Updating instance_info_cache with network_info: [{"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:18:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f773babb-ab2c-4de7-a7fc-181bd3f9d0a4 req-6c35191e-eeb3-48c8-a7fb-874216d85484 service nova] Releasing lock "refresh_cache-9662557e-2e89-42a0-9f0d-2189f84eece6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:18:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-25cdba75-b566-4efd-bb6b-a3479f55e104 req-2bf32144-87f8-4976-ac64-ff23b3381cf1 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received event network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-25cdba75-b566-4efd-bb6b-a3479f55e104 req-2bf32144-87f8-4976-ac64-ff23b3381cf1 service nova] Acquiring lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-25cdba75-b566-4efd-bb6b-a3479f55e104 req-2bf32144-87f8-4976-ac64-ff23b3381cf1 service nova] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-25cdba75-b566-4efd-bb6b-a3479f55e104 req-2bf32144-87f8-4976-ac64-ff23b3381cf1 service nova] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-25cdba75-b566-4efd-bb6b-a3479f55e104 req-2bf32144-87f8-4976-ac64-ff23b3381cf1 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] No waiting events found dispatching network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:53 user nova-compute[74681]: WARNING nova.compute.manager [req-25cdba75-b566-4efd-bb6b-a3479f55e104 req-2bf32144-87f8-4976-ac64-ff23b3381cf1 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received unexpected event network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 for instance with vm_state building and task_state spawning.
Aug 16 06:18:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166735.7079895, 9662557e-2e89-42a0-9f0d-2189f84eece6 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:55 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] VM Resumed (Lifecycle Event)
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:18:55 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Instance spawned successfully.
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-a71c2b05-2e6c-4cd4-9b9b-054cf4560d66 req-7a759fd3-dac6-41cb-ab03-e9c7b785fc80 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received event network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a71c2b05-2e6c-4cd4-9b9b-054cf4560d66 req-7a759fd3-dac6-41cb-ab03-e9c7b785fc80 service nova] Acquiring lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a71c2b05-2e6c-4cd4-9b9b-054cf4560d66 req-7a759fd3-dac6-41cb-ab03-e9c7b785fc80 service nova] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a71c2b05-2e6c-4cd4-9b9b-054cf4560d66 req-7a759fd3-dac6-41cb-ab03-e9c7b785fc80 service nova] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-a71c2b05-2e6c-4cd4-9b9b-054cf4560d66 req-7a759fd3-dac6-41cb-ab03-e9c7b785fc80 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] No waiting events found dispatching network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:18:55 user nova-compute[74681]: WARNING nova.compute.manager [req-a71c2b05-2e6c-4cd4-9b9b-054cf4560d66 req-7a759fd3-dac6-41cb-ab03-e9c7b785fc80 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received unexpected event network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 for instance with vm_state building and task_state spawning.
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:18:55 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166735.7122617, 9662557e-2e89-42a0-9f0d-2189f84eece6 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:55 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] VM Started (Lifecycle Event)
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:18:55 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:18:55 user nova-compute[74681]: INFO nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 16 06:18:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:55 user nova-compute[74681]: INFO nova.compute.manager [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Took 7.41 seconds to build instance.
Aug 16 06:18:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a73e29a6-e09a-4f09-90f4-403b9a29e26d tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.552s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:18:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:18:57 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166722.2973504, 02e364f9-af4e-40bb-a0b4-2b1864f54270 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:18:57 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] VM Stopped (Lifecycle Event)
Aug 16 06:18:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4191213c-b0d1-48be-8498-d14e631ff594 None None] [instance: 02e364f9-af4e-40bb-a0b4-2b1864f54270] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:18:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "ab220126-7cda-4787-96b5-4836eb31b18b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "ab220126-7cda-4787-96b5-4836eb31b18b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:19:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:19:10 user nova-compute[74681]: INFO nova.compute.claims [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Claim successful on node user
Aug 16 06:19:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.network.neutron [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:19:11 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.policy [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a08f5511fea4a4399ea890af2e78807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fb12f1b9b84c128b9a9f5fcdb32c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:19:11 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Creating image(s)
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "/opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "/opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.208s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.217s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk 1073741824" returned: 0 in 0.067s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.243s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG nova.network.neutron [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Successfully created port: 36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Cannot resize image /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG nova.objects.instance [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lazy-loading 'migration_context' on Instance uuid ab220126-7cda-4787-96b5-4836eb31b18b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Ensure instance console log exists: /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.network.neutron [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Successfully updated port: 36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "refresh_cache-ab220126-7cda-4787-96b5-4836eb31b18b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquired lock "refresh_cache-ab220126-7cda-4787-96b5-4836eb31b18b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.network.neutron [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-ebcaeea9-a765-4f36-820a-11bf9be40247 req-731135d3-9d62-44fe-aa79-7e5c3512192d service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received event network-changed-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-ebcaeea9-a765-4f36-820a-11bf9be40247 req-731135d3-9d62-44fe-aa79-7e5c3512192d service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Refreshing instance network info cache due to event network-changed-36166625-6cf3-49f4-8a01-8a85d7fded91. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ebcaeea9-a765-4f36-820a-11bf9be40247 req-731135d3-9d62-44fe-aa79-7e5c3512192d service nova] Acquiring lock "refresh_cache-ab220126-7cda-4787-96b5-4836eb31b18b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.network.neutron [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.network.neutron [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Updating instance_info_cache with network_info: [{"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Releasing lock "refresh_cache-ab220126-7cda-4787-96b5-4836eb31b18b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Instance network_info: |[{"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ebcaeea9-a765-4f36-820a-11bf9be40247 req-731135d3-9d62-44fe-aa79-7e5c3512192d service nova] Acquired lock "refresh_cache-ab220126-7cda-4787-96b5-4836eb31b18b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.network.neutron [req-ebcaeea9-a765-4f36-820a-11bf9be40247 req-731135d3-9d62-44fe-aa79-7e5c3512192d service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Refreshing network info cache for port 36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:19:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Start _get_guest_xml network_info=[{"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:19:14 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:19:14 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1478008224',display_name='tempest-VolumesActionsTest-instance-1478008224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1478008224',id=27,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47fb12f1b9b84c128b9a9f5fcdb32c7d',ramdisk_id='',reservation_id='r-sc536iv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1652006769',owner_user_name='tempest-VolumesActionsTest-1652006769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:19:12Z,user_data=None,user_id='5a08f5511fea4a4399ea890af2e78807',uuid=ab220126-7cda-4787-96b5-4836eb31b18b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Converting VIF {"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c9:b4,bridge_name='br-int',has_traffic_filtering=True,id=36166625-6cf3-49f4-8a01-8a85d7fded91,network=Network(22655d17-1e6d-4df4-bc29-88a8811e036b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36166625-6c') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.objects.instance [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lazy-loading 'pci_devices' on Instance uuid ab220126-7cda-4787-96b5-4836eb31b18b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:19:14 user nova-compute[74681]:   <uuid>ab220126-7cda-4787-96b5-4836eb31b18b</uuid>
Aug 16 06:19:14 user nova-compute[74681]:   <name>instance-0000001b</name>
Aug 16 06:19:14 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:19:14 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:19:14 user nova-compute[74681]:   <metadata>
Aug 16 06:19:14 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:19:14 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:19:14 user nova-compute[74681]:       <nova:name>tempest-VolumesActionsTest-instance-1478008224</nova:name>
Aug 16 06:19:14 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:19:14</nova:creationTime>
Aug 16 06:19:14 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:19:14 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:19:14 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:19:14 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:19:14 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:19:14 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:19:14 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:19:14 user nova-compute[74681]:       <nova:owner>
Aug 16 06:19:14 user nova-compute[74681]:         <nova:user uuid="5a08f5511fea4a4399ea890af2e78807">tempest-VolumesActionsTest-1652006769-project-member</nova:user>
Aug 16 06:19:14 user nova-compute[74681]:         <nova:project uuid="47fb12f1b9b84c128b9a9f5fcdb32c7d">tempest-VolumesActionsTest-1652006769</nova:project>
Aug 16 06:19:14 user nova-compute[74681]:       </nova:owner>
Aug 16 06:19:14 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:19:14 user nova-compute[74681]:       <nova:ports>
Aug 16 06:19:14 user nova-compute[74681]:         <nova:port uuid="36166625-6cf3-49f4-8a01-8a85d7fded91">
Aug 16 06:19:14 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 06:19:14 user nova-compute[74681]:         </nova:port>
Aug 16 06:19:14 user nova-compute[74681]:       </nova:ports>
Aug 16 06:19:14 user nova-compute[74681]:     </nova:instance>
Aug 16 06:19:14 user nova-compute[74681]:   </metadata>
Aug 16 06:19:14 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:19:14 user nova-compute[74681]:     <system>
Aug 16 06:19:14 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:19:14 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:19:14 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:19:14 user nova-compute[74681]:       <entry name="serial">ab220126-7cda-4787-96b5-4836eb31b18b</entry>
Aug 16 06:19:14 user nova-compute[74681]:       <entry name="uuid">ab220126-7cda-4787-96b5-4836eb31b18b</entry>
Aug 16 06:19:14 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:19:14 user nova-compute[74681]:     </system>
Aug 16 06:19:14 user nova-compute[74681]:   </sysinfo>
Aug 16 06:19:14 user nova-compute[74681]:   <os>
Aug 16 06:19:14 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:19:14 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:19:14 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:19:14 user nova-compute[74681]:   </os>
Aug 16 06:19:14 user nova-compute[74681]:   <features>
Aug 16 06:19:14 user nova-compute[74681]:     <acpi/>
Aug 16 06:19:14 user nova-compute[74681]:     <apic/>
Aug 16 06:19:14 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:19:14 user nova-compute[74681]:   </features>
Aug 16 06:19:14 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:19:14 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:19:14 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:19:14 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:19:14 user nova-compute[74681]:   </clock>
Aug 16 06:19:14 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:19:14 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:19:14 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:19:14 user nova-compute[74681]:   </cpu>
Aug 16 06:19:14 user nova-compute[74681]:   <devices>
Aug 16 06:19:14 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:19:14 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:19:14 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk"/>
Aug 16 06:19:14 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:19:14 user nova-compute[74681]:     </disk>
Aug 16 06:19:14 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:19:14 user nova-compute[74681]:       <mac address="fa:16:3e:08:c9:b4"/>
Aug 16 06:19:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:19:14 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:19:14 user nova-compute[74681]:       <target dev="tap36166625-6c"/>
Aug 16 06:19:14 user nova-compute[74681]:     </interface>
Aug 16 06:19:14 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:19:14 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/console.log" append="off"/>
Aug 16 06:19:14 user nova-compute[74681]:     </serial>
Aug 16 06:19:14 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:19:14 user nova-compute[74681]:     <video>
Aug 16 06:19:14 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:19:14 user nova-compute[74681]:     </video>
Aug 16 06:19:14 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:19:14 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:19:14 user nova-compute[74681]:     </rng>
Aug 16 06:19:14 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:19:14 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:19:14 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:19:14 user nova-compute[74681]:     </memballoon>
Aug 16 06:19:14 user nova-compute[74681]:   </devices>
Aug 16 06:19:14 user nova-compute[74681]: </domain>
Aug 16 06:19:14 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1478008224',display_name='tempest-VolumesActionsTest-instance-1478008224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1478008224',id=27,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47fb12f1b9b84c128b9a9f5fcdb32c7d',ramdisk_id='',reservation_id='r-sc536iv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1652006769',owner_user_name='tempest-VolumesActionsTest-1652006769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:19:12Z,user_data=None,user_id='5a08f5511fea4a4399ea890af2e78807',uuid=ab220126-7cda-4787-96b5-4836eb31b18b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Converting VIF {"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c9:b4,bridge_name='br-int',has_traffic_filtering=True,id=36166625-6cf3-49f4-8a01-8a85d7fded91,network=Network(22655d17-1e6d-4df4-bc29-88a8811e036b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36166625-6c') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG os_vif [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c9:b4,bridge_name='br-int',has_traffic_filtering=True,id=36166625-6cf3-49f4-8a01-8a85d7fded91,network=Network(22655d17-1e6d-4df4-bc29-88a8811e036b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36166625-6c') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36166625-6c, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36166625-6c, col_values=(('external_ids', {'iface-id': '36166625-6cf3-49f4-8a01-8a85d7fded91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:c9:b4', 'vm-uuid': 'ab220126-7cda-4787-96b5-4836eb31b18b'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:14 user nova-compute[74681]: INFO os_vif [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c9:b4,bridge_name='br-int',has_traffic_filtering=True,id=36166625-6cf3-49f4-8a01-8a85d7fded91,network=Network(22655d17-1e6d-4df4-bc29-88a8811e036b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36166625-6c')
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] No VIF found with MAC fa:16:3e:08:c9:b4, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.network.neutron [req-ebcaeea9-a765-4f36-820a-11bf9be40247 req-731135d3-9d62-44fe-aa79-7e5c3512192d service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Updated VIF entry in instance network info cache for port 36166625-6cf3-49f4-8a01-8a85d7fded91. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG nova.network.neutron [req-ebcaeea9-a765-4f36-820a-11bf9be40247 req-731135d3-9d62-44fe-aa79-7e5c3512192d service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Updating instance_info_cache with network_info: [{"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ebcaeea9-a765-4f36-820a-11bf9be40247 req-731135d3-9d62-44fe-aa79-7e5c3512192d service nova] Releasing lock "refresh_cache-ab220126-7cda-4787-96b5-4836eb31b18b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:19:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-ac7952fe-417b-46a5-b740-dcec9c885132 req-c964a8f3-561c-494c-b470-02b59a31bd73 service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received event network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ac7952fe-417b-46a5-b740-dcec9c885132 req-c964a8f3-561c-494c-b470-02b59a31bd73 service nova] Acquiring lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ac7952fe-417b-46a5-b740-dcec9c885132 req-c964a8f3-561c-494c-b470-02b59a31bd73 service nova] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ac7952fe-417b-46a5-b740-dcec9c885132 req-c964a8f3-561c-494c-b470-02b59a31bd73 service nova] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-ac7952fe-417b-46a5-b740-dcec9c885132 req-c964a8f3-561c-494c-b470-02b59a31bd73 service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] No waiting events found dispatching network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:15 user nova-compute[74681]: WARNING nova.compute.manager [req-ac7952fe-417b-46a5-b740-dcec9c885132 req-c964a8f3-561c-494c-b470-02b59a31bd73 service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received unexpected event network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 for instance with vm_state building and task_state spawning.
Aug 16 06:19:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166757.6575837, ab220126-7cda-4787-96b5-4836eb31b18b => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:19:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] VM Resumed (Lifecycle Event)
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:19:17 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Instance spawned successfully.
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166757.6595256, ab220126-7cda-4787-96b5-4836eb31b18b => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:19:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] VM Started (Lifecycle Event)
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:19:17 user nova-compute[74681]: INFO nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Took 6.18 seconds to spawn the instance on the hypervisor.
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received event network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] Acquiring lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] No waiting events found dispatching network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:17 user nova-compute[74681]: WARNING nova.compute.manager [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received unexpected event network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 for instance with vm_state active and task_state None.
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-changed-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Refreshing instance network info cache due to event network-changed-e207d8ba-006f-49c7-8166-227fa1009a28. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] Acquiring lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] Acquired lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:19:17 user nova-compute[74681]: DEBUG nova.network.neutron [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Refreshing network info cache for port e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:19:17 user nova-compute[74681]: INFO nova.compute.manager [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Took 7.05 seconds to build instance.
Aug 16 06:19:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99752b39-142d-4d10-8d92-819aa1c1eb7b tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "ab220126-7cda-4787-96b5-4836eb31b18b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.152s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:18 user nova-compute[74681]: DEBUG nova.network.neutron [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updated VIF entry in instance network info cache for port e207d8ba-006f-49c7-8166-227fa1009a28. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:19:18 user nova-compute[74681]: DEBUG nova.network.neutron [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updating instance_info_cache with network_info: [{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c4fb923f-829d-4d54-92a1-f5cd98bbf8cf req-eb204dd4-7234-4380-a765-b96bb6394b6d service nova] Releasing lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:19:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:21 user nova-compute[74681]: INFO nova.compute.manager [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Shelving
Aug 16 06:19:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-2405d6c1-115f-4534-a6c7-97aa92c46941 req-5af9eeb7-b9f1-445f-9986-43b564b6d0ce service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-unplugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2405d6c1-115f-4534-a6c7-97aa92c46941 req-5af9eeb7-b9f1-445f-9986-43b564b6d0ce service nova] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2405d6c1-115f-4534-a6c7-97aa92c46941 req-5af9eeb7-b9f1-445f-9986-43b564b6d0ce service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2405d6c1-115f-4534-a6c7-97aa92c46941 req-5af9eeb7-b9f1-445f-9986-43b564b6d0ce service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-2405d6c1-115f-4534-a6c7-97aa92c46941 req-5af9eeb7-b9f1-445f-9986-43b564b6d0ce service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] No waiting events found dispatching network-vif-unplugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:22 user nova-compute[74681]: WARNING nova.compute.manager [req-2405d6c1-115f-4534-a6c7-97aa92c46941 req-5af9eeb7-b9f1-445f-9986-43b564b6d0ce service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received unexpected event network-vif-unplugged-e207d8ba-006f-49c7-8166-227fa1009a28 for instance with vm_state active and task_state shelving.
Aug 16 06:19:22 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance destroyed successfully.
Aug 16 06:19:22 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Beginning cold snapshot process
Aug 16 06:19:23 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:19:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk /opt/stack/data/nova/instances/snapshots/tmpeied5p1n/12ae3a85c3094b4c8ab7f6106ca5daaa {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk /opt/stack/data/nova/instances/snapshots/tmpeied5p1n/12ae3a85c3094b4c8ab7f6106ca5daaa" returned: 0 in 0.728s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Snapshot extracted, beginning image upload
Aug 16 06:19:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f4fe3ec-490d-4286-84df-374f8e95f559 req-e59ace3c-c649-454f-9718-b4090301cbe6 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f4fe3ec-490d-4286-84df-374f8e95f559 req-e59ace3c-c649-454f-9718-b4090301cbe6 service nova] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f4fe3ec-490d-4286-84df-374f8e95f559 req-e59ace3c-c649-454f-9718-b4090301cbe6 service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f4fe3ec-490d-4286-84df-374f8e95f559 req-e59ace3c-c649-454f-9718-b4090301cbe6 service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f4fe3ec-490d-4286-84df-374f8e95f559 req-e59ace3c-c649-454f-9718-b4090301cbe6 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] No waiting events found dispatching network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:24 user nova-compute[74681]: WARNING nova.compute.manager [req-4f4fe3ec-490d-4286-84df-374f8e95f559 req-e59ace3c-c649-454f-9718-b4090301cbe6 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received unexpected event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 06:19:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:24 user nova-compute[74681]: INFO nova.compute.manager [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Terminating instance
Aug 16 06:19:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-502d2b40-bd87-4ed5-a1bf-b486409dfafe req-3034d2ea-9839-4505-b880-38a7c42125bb service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-unplugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-502d2b40-bd87-4ed5-a1bf-b486409dfafe req-3034d2ea-9839-4505-b880-38a7c42125bb service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-502d2b40-bd87-4ed5-a1bf-b486409dfafe req-3034d2ea-9839-4505-b880-38a7c42125bb service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-502d2b40-bd87-4ed5-a1bf-b486409dfafe req-3034d2ea-9839-4505-b880-38a7c42125bb service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-502d2b40-bd87-4ed5-a1bf-b486409dfafe req-3034d2ea-9839-4505-b880-38a7c42125bb service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] No waiting events found dispatching network-vif-unplugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-502d2b40-bd87-4ed5-a1bf-b486409dfafe req-3034d2ea-9839-4505-b880-38a7c42125bb service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-unplugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:19:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Instance destroyed successfully.
Aug 16 06:19:25 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lazy-loading 'resources' on Instance uuid e7e44f1a-d07e-4b37-bed0-9cf141649d6d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-267678761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-808346252',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZrGW8nCbzlOoz04Zj2fEVg2OyB0Rht/GlEgqvRO5/aJEfk6k8Fi2kVkXuk25bslUvg9+k0B+zN2Q16i9fyuVIwokT7VL79iIqXpmvSbcoHpdzDKcJMOcxZjGPcryb0wg==',key_name='tempest-keypair-1235458036',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='824dea21de1d4cce8d70be10c5a5942b',ramdisk_id='',reservation_id='r-i4kh4yos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1593902319',owner_user_name='tempest-ServerActionsV293TestJSON-1593902319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7666caaf93494e07baf06aca64090235',uuid=e7e44f1a-d07e-4b37-bed0-9cf141649d6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converting VIF {"id": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "address": "fa:16:3e:6a:71:f4", "network": {"id": "c216da6f-95ab-474e-980d-9c913547e1ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1817788468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "824dea21de1d4cce8d70be10c5a5942b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a5e5902-78", "ovs_interfaceid": "7a5e5902-78fd-4339-8aa2-91c8cd2cb239", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_vif [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a5e5902-78, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:25 user nova-compute[74681]: INFO os_vif [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:71:f4,bridge_name='br-int',has_traffic_filtering=True,id=7a5e5902-78fd-4339-8aa2-91c8cd2cb239,network=Network(c216da6f-95ab-474e-980d-9c913547e1ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a5e5902-78')
Aug 16 06:19:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zHeMcTVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:19:25 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb83f4f9-135b-4d71-b638-31b9a147fbc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[722697b6-7681-4909-9f82-9ab0c308a0e7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:19:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d (non-flash)
Aug 16 06:19:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948427c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7435dd1-4b97-4d5c-859b-6a6bf519f6d9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0250d638-ec4f-42a4-82ad-658650f3dd80]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b39528-0f2f-4eb6-baa7-a5117f164eaa]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a8b61b-2558-4b04-85ec-5f058ab7a18b]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:19:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed82c99-2e63-45d4-a450-65c916ee46e3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeea65a-3dca-44cc-8887-090db5a8acc1]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260]
Aug 16 06:19:26 user nova-compute[74681]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d, portal: 172.16.0.220,3260] successful.
Aug 16 06:19:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce7b0de-d115-4b09-a780-a23b962bdf2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[575a3c52-5fa8-447e-8f3b-231203a93bb5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] <== disconnect_volume: return (375ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:19:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Deleting instance files /opt/stack/data/nova/instances/e7e44f1a-d07e-4b37-bed0-9cf141649d6d_del
Aug 16 06:19:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Deletion of /opt/stack/data/nova/instances/e7e44f1a-d07e-4b37-bed0-9cf141649d6d_del complete
Aug 16 06:19:26 user nova-compute[74681]: INFO nova.compute.manager [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:19:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Snapshot image upload complete
Aug 16 06:19:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:26 user nova-compute[74681]: INFO nova.compute.manager [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Shelve offloading
Aug 16 06:19:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance destroyed successfully.
Aug 16 06:19:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquired lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:19:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:19:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-6664b533-08cf-4b58-8cc3-299d1db776ef req-1d92cfb2-a027-46f3-86c5-0367671b0925 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6664b533-08cf-4b58-8cc3-299d1db776ef req-1d92cfb2-a027-46f3-86c5-0367671b0925 service nova] Acquiring lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6664b533-08cf-4b58-8cc3-299d1db776ef req-1d92cfb2-a027-46f3-86c5-0367671b0925 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6664b533-08cf-4b58-8cc3-299d1db776ef req-1d92cfb2-a027-46f3-86c5-0367671b0925 service nova] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-6664b533-08cf-4b58-8cc3-299d1db776ef req-1d92cfb2-a027-46f3-86c5-0367671b0925 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] No waiting events found dispatching network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:27 user nova-compute[74681]: WARNING nova.compute.manager [req-6664b533-08cf-4b58-8cc3-299d1db776ef req-1d92cfb2-a027-46f3-86c5-0367671b0925 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received unexpected event network-vif-plugged-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 for instance with vm_state active and task_state deleting.
Aug 16 06:19:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updating instance_info_cache with network_info: [{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Releasing lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:19:27 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:27 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Took 1.56 seconds to deallocate network for instance.
Aug 16 06:19:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-4dad5244-6b56-4e61-996e-29d81614e37f req-7a57fdca-f282-4208-a515-dfa78145c130 service nova] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Received event network-vif-deleted-7a5e5902-78fd-4339-8aa2-91c8cd2cb239 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance destroyed successfully.
Aug 16 06:19:28 user nova-compute[74681]: DEBUG nova.objects.instance [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'resources' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1176396881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1176396881',id=22,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCpwDAIgdlWm3QRLdDXekBMeHU+NMDigNAkU342zi7/hIVEgAx/QvGX2TSqaNifbIdghzAwqEWT4JEoxkV1nm8yRPJ91JXtgmrMlWeL6vkPb0ppFUZrFgbC3YHx84+sZQ==',key_name='tempest-keypair-1791209110',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-ktpwt4ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member',shelved_at='2023-08-16T06:19:26.256792',shelved_host='user',shelved_image_id='ea058060-87a0-430d-9b5b-a56d3ee76621'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=20509fce-ff8d-4edc-85e9-c54375c274da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG os_vif [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape207d8ba-00, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:19:28 user nova-compute[74681]: INFO os_vif [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00')
Aug 16 06:19:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Deleting instance files /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da_del
Aug 16 06:19:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Deletion of /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da_del complete
Aug 16 06:19:28 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Deleted allocations for instance 20509fce-ff8d-4edc-85e9-c54375c274da
Aug 16 06:19:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG nova.objects.instance [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'numa_topology' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:19:28 user nova-compute[74681]: INFO nova.compute.manager [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Took 0.93 seconds to detach 1 volumes for instance.
Aug 16 06:19:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Deleting volume: 4ce7b0de-d115-4b09-a780-a23b962bdf2d {{(pid=74681) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-23ba4816-4705-44ba-ae38-ed313179faed tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.845s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:29 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:19:29 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:19:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:29 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Deleted allocations for instance e7e44f1a-d07e-4b37-bed0-9cf141649d6d
Aug 16 06:19:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8830e6ce-c208-4cf8-a707-10a45c7a6b7d tempest-ServerActionsV293TestJSON-1593902319 tempest-ServerActionsV293TestJSON-1593902319-project-member] Lock "e7e44f1a-d07e-4b37-bed0-9cf141649d6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.466s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:37 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:19:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:19:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:19:37 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:19:37 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166762.813887, 20509fce-ff8d-4edc-85e9-c54375c274da => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:19:37 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] VM Stopped (Lifecycle Event)
Aug 16 06:19:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f18ddda4-1406-44cb-b7fa-bfe5310ace04 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updating instance_info_cache with network_info: [{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:38 user nova-compute[74681]: INFO nova.compute.manager [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Terminating instance
Aug 16 06:19:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-8c827e6f-ca0c-4951-aad5-60d0209d03fe req-82c1a34b-ffb0-4dc4-b060-f75b38ff0dc1 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received event network-vif-unplugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8c827e6f-ca0c-4951-aad5-60d0209d03fe req-82c1a34b-ffb0-4dc4-b060-f75b38ff0dc1 service nova] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8c827e6f-ca0c-4951-aad5-60d0209d03fe req-82c1a34b-ffb0-4dc4-b060-f75b38ff0dc1 service nova] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8c827e6f-ca0c-4951-aad5-60d0209d03fe req-82c1a34b-ffb0-4dc4-b060-f75b38ff0dc1 service nova] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-8c827e6f-ca0c-4951-aad5-60d0209d03fe req-82c1a34b-ffb0-4dc4-b060-f75b38ff0dc1 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] No waiting events found dispatching network-vif-unplugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-8c827e6f-ca0c-4951-aad5-60d0209d03fe req-82c1a34b-ffb0-4dc4-b060-f75b38ff0dc1 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received event network-vif-unplugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:39 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Instance destroyed successfully.
Aug 16 06:19:39 user nova-compute[74681]: DEBUG nova.objects.instance [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'resources' on Instance uuid 84979ec3-09d4-4463-a20b-ca5dcf6986de {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-786394704',display_name='tempest-AttachVolumeNegativeTest-server-786394704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-786394704',id=21,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwW0ziruig+Bf1GRbamUDusIQjSr2dZuojMJCgEWR1XNJjztmIgBfYNw1HBNm8O8zI0b1YaYVD1/CurIejhbrkN7tsGxH5QCMtsa2IpugHpiOljqv2jXP0SDYT6pRQ0yg==',key_name='tempest-keypair-1851072068',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:16:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-4h2nl7v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:16:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=84979ec3-09d4-4463-a20b-ca5dcf6986de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "address": "fa:16:3e:7b:20:f7", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap708a7b8d-8a", "ovs_interfaceid": "708a7b8d-8aee-4623-9ce7-fc3026329b9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:20:f7,bridge_name='br-int',has_traffic_filtering=True,id=708a7b8d-8aee-4623-9ce7-fc3026329b9a,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708a7b8d-8a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG os_vif [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:20:f7,bridge_name='br-int',has_traffic_filtering=True,id=708a7b8d-8aee-4623-9ce7-fc3026329b9a,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708a7b8d-8a') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap708a7b8d-8a, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:39 user nova-compute[74681]: INFO os_vif [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:20:f7,bridge_name='br-int',has_traffic_filtering=True,id=708a7b8d-8aee-4623-9ce7-fc3026329b9a,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap708a7b8d-8a')
Aug 16 06:19:39 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Deleting instance files /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de_del
Aug 16 06:19:39 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Deletion of /opt/stack/data/nova/instances/84979ec3-09d4-4463-a20b-ca5dcf6986de_del complete
Aug 16 06:19:39 user nova-compute[74681]: INFO nova.compute.manager [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 06:19:39 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:19:39 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:40 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Took 0.94 seconds to deallocate network for instance.
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166765.6588485, e7e44f1a-d07e-4b37-bed0-9cf141649d6d => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:19:40 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] VM Stopped (Lifecycle Event)
Aug 16 06:19:40 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Deleted allocations for instance 84979ec3-09d4-4463-a20b-ca5dcf6986de
Aug 16 06:19:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-22c2b4bf-4929-4f08-9d04-4e411ccb735d None None] [instance: e7e44f1a-d07e-4b37-bed0-9cf141649d6d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-f6b7c926-7dda-4594-a157-abd8059c7d87 req-17edd01c-d856-46cd-a37b-996c9c258335 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received event network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f6b7c926-7dda-4594-a157-abd8059c7d87 req-17edd01c-d856-46cd-a37b-996c9c258335 service nova] Acquiring lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f6b7c926-7dda-4594-a157-abd8059c7d87 req-17edd01c-d856-46cd-a37b-996c9c258335 service nova] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f6b7c926-7dda-4594-a157-abd8059c7d87 req-17edd01c-d856-46cd-a37b-996c9c258335 service nova] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-f6b7c926-7dda-4594-a157-abd8059c7d87 req-17edd01c-d856-46cd-a37b-996c9c258335 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] No waiting events found dispatching network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:40 user nova-compute[74681]: WARNING nova.compute.manager [req-f6b7c926-7dda-4594-a157-abd8059c7d87 req-17edd01c-d856-46cd-a37b-996c9c258335 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received unexpected event network-vif-plugged-708a7b8d-8aee-4623-9ce7-fc3026329b9a for instance with vm_state deleted and task_state None.
Aug 16 06:19:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-f6b7c926-7dda-4594-a157-abd8059c7d87 req-17edd01c-d856-46cd-a37b-996c9c258335 service nova] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Received event network-vif-deleted-708a7b8d-8aee-4623-9ce7-fc3026329b9a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-497482da-23f0-4cf3-aebb-1436196cf50f tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "84979ec3-09d4-4463-a20b-ca5dcf6986de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.401s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:19:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.449710845947266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ee235b33-937c-41f4-9052-fc7f9f200cbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a95646fe-8d93-47c7-9590-dbbb54c479d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 9662557e-2e89-42a0-9f0d-2189f84eece6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ab220126-7cda-4787-96b5-4836eb31b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:19:45 user nova-compute[74681]: INFO nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a has allocations against this compute host but is not found in the database.
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:19:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.128s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:19:46 user nova-compute[74681]: INFO nova.compute.claims [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Claim successful on node user
Aug 16 06:19:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:19:46 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.policy [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca629fd2ab8b4728a772af22f19f48e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50b9e6e8d18446baeb39b48b22aa64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:19:46 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Creating image(s)
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.172s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:19:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.170s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk 1073741824" returned: 0 in 0.070s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Successfully created port: f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Cannot resize image /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'migration_context' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Ensure instance console log exists: /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Successfully updated port: f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquired lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-24dd66d9-7737-4674-b0be-b635c950774b req-409d3685-53e2-401b-8b3b-531ce0ee7dbd service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-changed-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-24dd66d9-7737-4674-b0be-b635c950774b req-409d3685-53e2-401b-8b3b-531ce0ee7dbd service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Refreshing instance network info cache due to event network-changed-f2886dcc-dad5-4242-a05f-e88b51734354. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-24dd66d9-7737-4674-b0be-b635c950774b req-409d3685-53e2-401b-8b3b-531ce0ee7dbd service nova] Acquiring lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updating instance_info_cache with network_info: [{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Releasing lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance network_info: |[{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-24dd66d9-7737-4674-b0be-b635c950774b req-409d3685-53e2-401b-8b3b-531ce0ee7dbd service nova] Acquired lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.neutron [req-24dd66d9-7737-4674-b0be-b635c950774b req-409d3685-53e2-401b-8b3b-531ce0ee7dbd service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Refreshing network info cache for port f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Start _get_guest_xml network_info=[{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:19:48 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:19:48 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'pci_devices' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:19:48 user nova-compute[74681]:   <uuid>6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</uuid>
Aug 16 06:19:48 user nova-compute[74681]:   <name>instance-0000001c</name>
Aug 16 06:19:48 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:19:48 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:19:48 user nova-compute[74681]:   <metadata>
Aug 16 06:19:48 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:19:48 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:19:48 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeTestJSON-server-1103772826</nova:name>
Aug 16 06:19:48 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:19:48</nova:creationTime>
Aug 16 06:19:48 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:19:48 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:19:48 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:19:48 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:19:48 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:19:48 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:19:48 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:19:48 user nova-compute[74681]:       <nova:owner>
Aug 16 06:19:48 user nova-compute[74681]:         <nova:user uuid="ca629fd2ab8b4728a772af22f19f48e1">tempest-AttachVolumeTestJSON-436096878-project-member</nova:user>
Aug 16 06:19:48 user nova-compute[74681]:         <nova:project uuid="d50b9e6e8d18446baeb39b48b22aa64d">tempest-AttachVolumeTestJSON-436096878</nova:project>
Aug 16 06:19:48 user nova-compute[74681]:       </nova:owner>
Aug 16 06:19:48 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:19:48 user nova-compute[74681]:       <nova:ports>
Aug 16 06:19:48 user nova-compute[74681]:         <nova:port uuid="f2886dcc-dad5-4242-a05f-e88b51734354">
Aug 16 06:19:48 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 06:19:48 user nova-compute[74681]:         </nova:port>
Aug 16 06:19:48 user nova-compute[74681]:       </nova:ports>
Aug 16 06:19:48 user nova-compute[74681]:     </nova:instance>
Aug 16 06:19:48 user nova-compute[74681]:   </metadata>
Aug 16 06:19:48 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:19:48 user nova-compute[74681]:     <system>
Aug 16 06:19:48 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:19:48 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:19:48 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:19:48 user nova-compute[74681]:       <entry name="serial">6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</entry>
Aug 16 06:19:48 user nova-compute[74681]:       <entry name="uuid">6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</entry>
Aug 16 06:19:48 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:19:48 user nova-compute[74681]:     </system>
Aug 16 06:19:48 user nova-compute[74681]:   </sysinfo>
Aug 16 06:19:48 user nova-compute[74681]:   <os>
Aug 16 06:19:48 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:19:48 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:19:48 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:19:48 user nova-compute[74681]:   </os>
Aug 16 06:19:48 user nova-compute[74681]:   <features>
Aug 16 06:19:48 user nova-compute[74681]:     <acpi/>
Aug 16 06:19:48 user nova-compute[74681]:     <apic/>
Aug 16 06:19:48 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:19:48 user nova-compute[74681]:   </features>
Aug 16 06:19:48 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:19:48 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:19:48 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:19:48 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:19:48 user nova-compute[74681]:   </clock>
Aug 16 06:19:48 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:19:48 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:19:48 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:19:48 user nova-compute[74681]:   </cpu>
Aug 16 06:19:48 user nova-compute[74681]:   <devices>
Aug 16 06:19:48 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:19:48 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:19:48 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk"/>
Aug 16 06:19:48 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:19:48 user nova-compute[74681]:     </disk>
Aug 16 06:19:48 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:19:48 user nova-compute[74681]:       <mac address="fa:16:3e:c6:73:6f"/>
Aug 16 06:19:48 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:19:48 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:19:48 user nova-compute[74681]:       <target dev="tapf2886dcc-da"/>
Aug 16 06:19:48 user nova-compute[74681]:     </interface>
Aug 16 06:19:48 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:19:48 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/console.log" append="off"/>
Aug 16 06:19:48 user nova-compute[74681]:     </serial>
Aug 16 06:19:48 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:19:48 user nova-compute[74681]:     <video>
Aug 16 06:19:48 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:19:48 user nova-compute[74681]:     </video>
Aug 16 06:19:48 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:19:48 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:19:48 user nova-compute[74681]:     </rng>
Aug 16 06:19:48 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:19:48 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:19:48 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:19:48 user nova-compute[74681]:     </memballoon>
Aug 16 06:19:48 user nova-compute[74681]:   </devices>
Aug 16 06:19:48 user nova-compute[74681]: </domain>
Aug 16 06:19:48 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG os_vif [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2886dcc-da, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2886dcc-da, col_values=(('external_ids', {'iface-id': 'f2886dcc-dad5-4242-a05f-e88b51734354', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:73:6f', 'vm-uuid': '6297f1b7-34ea-4481-8d21-ead2bf0b3d2a'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:48 user nova-compute[74681]: INFO os_vif [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da')
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:19:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No VIF found with MAC fa:16:3e:c6:73:6f, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:19:49 user nova-compute[74681]: DEBUG nova.network.neutron [req-24dd66d9-7737-4674-b0be-b635c950774b req-409d3685-53e2-401b-8b3b-531ce0ee7dbd service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updated VIF entry in instance network info cache for port f2886dcc-dad5-4242-a05f-e88b51734354. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:19:49 user nova-compute[74681]: DEBUG nova.network.neutron [req-24dd66d9-7737-4674-b0be-b635c950774b req-409d3685-53e2-401b-8b3b-531ce0ee7dbd service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updating instance_info_cache with network_info: [{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:19:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-24dd66d9-7737-4674-b0be-b635c950774b req-409d3685-53e2-401b-8b3b-531ce0ee7dbd service nova] Releasing lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-bbee03fd-c977-42cf-ad88-e505b371283c req-9ac79f91-0afb-4eb7-aa8e-3e3aa7c8fdf2 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bbee03fd-c977-42cf-ad88-e505b371283c req-9ac79f91-0afb-4eb7-aa8e-3e3aa7c8fdf2 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bbee03fd-c977-42cf-ad88-e505b371283c req-9ac79f91-0afb-4eb7-aa8e-3e3aa7c8fdf2 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bbee03fd-c977-42cf-ad88-e505b371283c req-9ac79f91-0afb-4eb7-aa8e-3e3aa7c8fdf2 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-bbee03fd-c977-42cf-ad88-e505b371283c req-9ac79f91-0afb-4eb7-aa8e-3e3aa7c8fdf2 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:50 user nova-compute[74681]: WARNING nova.compute.manager [req-bbee03fd-c977-42cf-ad88-e505b371283c req-9ac79f91-0afb-4eb7-aa8e-3e3aa7c8fdf2 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state building and task_state spawning.
Aug 16 06:19:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166792.248742, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:19:52 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Resumed (Lifecycle Event)
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:19:52 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance spawned successfully.
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:19:52 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166792.2528267, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:19:52 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Started (Lifecycle Event)
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:19:52 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-39261f9f-716f-4b34-b2ff-8ea56cf155e0 req-63e1377f-1688-4cff-8104-8bf425729896 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-39261f9f-716f-4b34-b2ff-8ea56cf155e0 req-63e1377f-1688-4cff-8104-8bf425729896 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-39261f9f-716f-4b34-b2ff-8ea56cf155e0 req-63e1377f-1688-4cff-8104-8bf425729896 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-39261f9f-716f-4b34-b2ff-8ea56cf155e0 req-63e1377f-1688-4cff-8104-8bf425729896 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-39261f9f-716f-4b34-b2ff-8ea56cf155e0 req-63e1377f-1688-4cff-8104-8bf425729896 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:19:52 user nova-compute[74681]: WARNING nova.compute.manager [req-39261f9f-716f-4b34-b2ff-8ea56cf155e0 req-63e1377f-1688-4cff-8104-8bf425729896 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state building and task_state spawning.
Aug 16 06:19:52 user nova-compute[74681]: INFO nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 16 06:19:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:52 user nova-compute[74681]: INFO nova.compute.manager [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Took 6.63 seconds to build instance.
Aug 16 06:19:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d31ce502-5a69-4a2c-b6f3-7d3ec379b203 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.736s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:19:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:54 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166779.1535995, 84979ec3-09d4-4463-a20b-ca5dcf6986de => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:19:54 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] VM Stopped (Lifecycle Event)
Aug 16 06:19:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2fb38d9d-e9b3-42c0-8e39-dc977c35b101 None None] [instance: 84979ec3-09d4-4463-a20b-ca5dcf6986de] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:19:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:19:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:20:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:20:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:20:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:20:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-f1d2d9c9-672f-45a0-a4bb-b4043d5de406 req-a7b93b66-4877-4060-8bd4-2c970b29cd46 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received event network-changed-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-f1d2d9c9-672f-45a0-a4bb-b4043d5de406 req-a7b93b66-4877-4060-8bd4-2c970b29cd46 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Refreshing instance network info cache due to event network-changed-a1fe3499-88a0-4b80-81a2-8d1a4da52b14. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f1d2d9c9-672f-45a0-a4bb-b4043d5de406 req-a7b93b66-4877-4060-8bd4-2c970b29cd46 service nova] Acquiring lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f1d2d9c9-672f-45a0-a4bb-b4043d5de406 req-a7b93b66-4877-4060-8bd4-2c970b29cd46 service nova] Acquired lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-f1d2d9c9-672f-45a0-a4bb-b4043d5de406 req-a7b93b66-4877-4060-8bd4-2c970b29cd46 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Refreshing network info cache for port a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-f1d2d9c9-672f-45a0-a4bb-b4043d5de406 req-a7b93b66-4877-4060-8bd4-2c970b29cd46 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Updated VIF entry in instance network info cache for port a1fe3499-88a0-4b80-81a2-8d1a4da52b14. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-f1d2d9c9-672f-45a0-a4bb-b4043d5de406 req-a7b93b66-4877-4060-8bd4-2c970b29cd46 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Updating instance_info_cache with network_info: [{"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f1d2d9c9-672f-45a0-a4bb-b4043d5de406 req-a7b93b66-4877-4060-8bd4-2c970b29cd46 service nova] Releasing lock "refresh_cache-ee235b33-937c-41f4-9052-fc7f9f200cbe" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'flavor' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:10 user nova-compute[74681]: INFO nova.compute.manager [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Attaching volume a2f00b61-3c7f-4c25-8872-194ec197a42e to /dev/vdb
Aug 16 06:20:10 user nova-compute[74681]: DEBUG os_brick.utils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc064a-600f-43b2-bc62-be44156bfe4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6109088e-aff7-40b7-81cf-d04124d78b2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68e650b-8c5b-42f4-8ba3-ac0e1aa31276]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[790c16eb-dbcd-4853-9646-794c32524229]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:10 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:20:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4249d83f-620a-4b67-a73f-f146c8da5746]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG os_brick.utils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:10 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Updating existing volume attachment record: 64b31de0-8869-4640-8472-20519ce65ab0 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:20:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-980d2ad4-b323-447c-bc99-188093bc0612 req-a0dcac35-e4c9-4afc-b1f2-eeb5773054ff service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-changed-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-980d2ad4-b323-447c-bc99-188093bc0612 req-a0dcac35-e4c9-4afc-b1f2-eeb5773054ff service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Refreshing instance network info cache due to event network-changed-b97e373d-1e74-46db-b24a-be1e723bd5ae. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-980d2ad4-b323-447c-bc99-188093bc0612 req-a0dcac35-e4c9-4afc-b1f2-eeb5773054ff service nova] Acquiring lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-980d2ad4-b323-447c-bc99-188093bc0612 req-a0dcac35-e4c9-4afc-b1f2-eeb5773054ff service nova] Acquired lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG nova.network.neutron [req-980d2ad4-b323-447c-bc99-188093bc0612 req-a0dcac35-e4c9-4afc-b1f2-eeb5773054ff service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Refreshing network info cache for port b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG nova.network.neutron [req-980d2ad4-b323-447c-bc99-188093bc0612 req-a0dcac35-e4c9-4afc-b1f2-eeb5773054ff service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updated VIF entry in instance network info cache for port b97e373d-1e74-46db-b24a-be1e723bd5ae. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG nova.network.neutron [req-980d2ad4-b323-447c-bc99-188093bc0612 req-a0dcac35-e4c9-4afc-b1f2-eeb5773054ff service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updating instance_info_cache with network_info: [{"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-980d2ad4-b323-447c-bc99-188093bc0612 req-a0dcac35-e4c9-4afc-b1f2-eeb5773054ff service nova] Releasing lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'flavor' on Instance uuid a95646fe-8d93-47c7-9590-dbbb54c479d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:17 user nova-compute[74681]: INFO nova.compute.manager [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Attaching volume c4eea268-17a0-4767-9184-52afb629e355 to /dev/vdb
Aug 16 06:20:17 user nova-compute[74681]: DEBUG os_brick.utils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a23723-340b-460e-b069-cc2bfcac21aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0559fb-4326-4cb0-a3fd-55a71565825a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[70349765-7f80-4383-b5a6-a96fde0fd9ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03c850c-7525-499e-bf71-c38913f87b74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:18 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:20:18 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2e1334-d161-4429-9c34-213e23a20e5f]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG os_brick.utils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updating existing volume attachment record: 3d3c0039-d728-46ed-9fc0-0842380d9253 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:20:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLnEaqpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:19 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:19 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:19 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cad78c3-4f47-4aa3-a502-7bad11aa465b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:20:19 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cb5fcb-c915-41f7-bf4e-9cbcf99522dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e] added
Aug 16 06:20:19 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec53a27-c197-438e-852e-bb739a54cb6e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[236d2ec4-cd6c-4f35-9b9d-d27af53b6304]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VLnEaqpW {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VLnEaqpW" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eae358-7899-4c2f-98e4-48419632ce5c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VLnEaqpW'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac54e0c8-ff8a-4858-aa24-d97db3bc4e06]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e190ac3-0d5e-4196-8417-2b1cc08415ac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:20:19 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:20:19 user nova-compute[74681]:  {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:19 user nova-compute[74681]: WARNING os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 06:20:19 user nova-compute[74681]: 
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f43100-30c5-4d8b-96af-c7fa64d0a029]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e, portal: 172.16.0.220,3260]
Aug 16 06:20:19 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e, portal: 172.16.0.220,3260] successful.
Aug 16 06:20:19 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[439913a1-d856-49dd-a8fc-2d1273c8275c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b4e8d3-eec6-4c28-89d7-2daf108dc170]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:19 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:20 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6938f722-8b5b-4d9c-ae75-cbefa0118fe9]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:20:20 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLnEaqpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26230336266323733', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230336266323733', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'flavor' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:20:21 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:21 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:20:21 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:20:21 user nova-compute[74681]:   <serial>a2f00b61-3c7f-4c25-8872-194ec197a42e</serial>
Aug 16 06:20:21 user nova-compute[74681]: </disk>
Aug 16 06:20:21 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No VIF found with MAC fa:16:3e:cf:89:fd, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:20:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cf570d2e-c786-43c6-96f5-bc5ae9d3964a tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.648s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'flavor' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:24 user nova-compute[74681]: INFO nova.compute.manager [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Attaching volume ac31e238-61f5-425c-86c3-96493f1135a1 to /dev/vdc
Aug 16 06:20:25 user nova-compute[74681]: DEBUG os_brick.utils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e7930b-83d3-4e5a-878a-d7c5790c0df7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa9753-e5fa-4092-8e88-b55eeedd6241]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dd6939-15dc-4fb6-b352-fea04dcdc98a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e91a176-19a5-4e0e-bc15-1aaba2194cc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:25 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:20:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[386f0c3c-d71b-4bed-9fd8-8fabe2f0422e]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG os_brick.utils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:25 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Updating existing volume attachment record: d517be67-6b11-496c-937d-6779226f726c {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:20:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdtvCTqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:27 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:27 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:27 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fb0a85-70ef-4cf8-86e8-833719ba2424]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:20:27 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[14051ca8-03cc-48e8-bfd0-55df2cd5c3fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355] added
Aug 16 06:20:27 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16fb0b4-697d-4b64-8de4-0bdd94650247]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bba8181-a64e-4835-af25-df0cc3120f61]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdtvCTqu {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdtvCTqu" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[341be9d3-42e5-4a69-aea3-e3d9fee2db50]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zdtvCTqu'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[627d9181-c700-4471-a2f8-39a8d378819c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b122c-0401-49bd-9199-a95b9419e4ee]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:27 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:27 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[35159e35-7eea-4fd6-9083-4147580d55ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355, portal: 172.16.0.220,3260]
Aug 16 06:20:28 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355, portal: 172.16.0.220,3260] successful.
Aug 16 06:20:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab4e5a2-65d9-4a32-89ec-1e2de2bee8ef]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1135d0-35fe-414f-b60a-16b761bf1441]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:28 user nova-compute[74681]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 (non-flash)
Aug 16 06:20:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:28 user nova-compute[74681]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 (non-flash)
Aug 16 06:20:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ae2dac-a5f4-441f-a85e-ab59d09fbf85]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdtvCTqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26535386466666633', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535386466666633', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'flavor' on Instance uuid a95646fe-8d93-47c7-9590-dbbb54c479d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:20:29 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:29 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:20:29 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:20:29 user nova-compute[74681]:   <serial>c4eea268-17a0-4767-9184-52afb629e355</serial>
Aug 16 06:20:29 user nova-compute[74681]: </disk>
Aug 16 06:20:29 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No VIF found with MAC fa:16:3e:ec:f3:59, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:20:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8c6b739d-6929-4e49-a96b-217dc72e72a1 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.880s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "31137824-5fa9-44e3-86ca-5d0587c28454" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:20:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:20:30 user nova-compute[74681]: INFO nova.compute.claims [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Claim successful on node user
Aug 16 06:20:30 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:20:30 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:20:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:20:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG nova.policy [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '361d070042c54dd59f7179619de1d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd289f0a66d5047b7b1be8ca5d969eaea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:20:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Creating image(s)
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "/opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "/opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "/opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk 1073741824" returned: 0 in 0.054s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:20:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.network.neutron [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Successfully created port: d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Cannot resize image /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'migration_context' on Instance uuid 31137824-5fa9-44e3-86ca-5d0587c28454 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Ensure instance console log exists: /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Detaching volume c4eea268-17a0-4767-9184-52afb629e355
Aug 16 06:20:32 user nova-compute[74681]: INFO nova.virt.block_device [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Attempting to driver detach volume c4eea268-17a0-4767-9184-52afb629e355 from mountpoint /dev/vdb
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Attempting to detach device vdb from instance a95646fe-8d93-47c7-9590-dbbb54c479d2 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:20:32 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:32 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:20:32 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:20:32 user nova-compute[74681]:   <serial>c4eea268-17a0-4767-9184-52afb629e355</serial>
Aug 16 06:20:32 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:20:32 user nova-compute[74681]: </disk>
Aug 16 06:20:32 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:20:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Successfully detached device vdb from instance a95646fe-8d93-47c7-9590-dbbb54c479d2 from the persistent domain config.
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a95646fe-8d93-47c7-9590-dbbb54c479d2 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:20:32 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:32 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:20:32 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:20:32 user nova-compute[74681]:   <serial>c4eea268-17a0-4767-9184-52afb629e355</serial>
Aug 16 06:20:32 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:20:32 user nova-compute[74681]: </disk>
Aug 16 06:20:32 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:20:32 user nova-compute[74681]: INFO nova.compute.claims [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Claim successful on node user
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Successfully updated port: d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquired lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-4cc2e6a6-14a0-4962-9d9a-b89bf727a2b5 req-928d97b2-201e-4b04-a403-1a88a8a33cf5 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received event network-changed-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-4cc2e6a6-14a0-4962-9d9a-b89bf727a2b5 req-928d97b2-201e-4b04-a403-1a88a8a33cf5 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Refreshing instance network info cache due to event network-changed-d69de54a-f521-4ad2-95cc-b62e0dc878f1. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4cc2e6a6-14a0-4962-9d9a-b89bf727a2b5 req-928d97b2-201e-4b04-a403-1a88a8a33cf5 service nova] Acquiring lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166833.1159143, a95646fe-8d93-47c7-9590-dbbb54c479d2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a95646fe-8d93-47c7-9590-dbbb54c479d2 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:20:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Successfully detached device vdb from instance a95646fe-8d93-47c7-9590-dbbb54c479d2 from the live domain config.
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdtvCTqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:33 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257d72f-1740-48eb-8111-69e695bbd614]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e374a875-3f30-4937-aa3f-b9d31967ed2f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:33 user nova-compute[74681]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 (non-flash)
Aug 16 06:20:33 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:33 user nova-compute[74681]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 (non-flash)
Aug 16 06:20:33 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94942a57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e2a66e-3708-4e10-98ec-65b8fbead387]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f304a2-05f5-4e65-a396-bda0c2e80a15]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd0c975-847c-446d-8b1c-224467dda8ac]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[11580626-8828-43e7-a71d-76aa53c620aa]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6624a5a2-3460-46e1-8a7e-694ee1550868]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a078469-efb1-42d7-bd4c-057e57822895]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355, portal: 172.16.0.220,3260]
Aug 16 06:20:33 user nova-compute[74681]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355, portal: 172.16.0.220,3260] successful.
Aug 16 06:20:33 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-28030477-78b3-4944-b7ab-a4e1d74a047d req-4c554dfb-28df-444c-9ac7-63535429449f service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-changed-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-28030477-78b3-4944-b7ab-a4e1d74a047d req-4c554dfb-28df-444c-9ac7-63535429449f service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Refreshing instance network info cache due to event network-changed-a2b31ee4-02ef-4ce4-87a1-8901f392593f. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-28030477-78b3-4944-b7ab-a4e1d74a047d req-4c554dfb-28df-444c-9ac7-63535429449f service nova] Acquiring lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-28030477-78b3-4944-b7ab-a4e1d74a047d req-4c554dfb-28df-444c-9ac7-63535429449f service nova] Acquired lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-28030477-78b3-4944-b7ab-a4e1d74a047d req-4c554dfb-28df-444c-9ac7-63535429449f service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Refreshing network info cache for port a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4eea268-17a0-4767-9184-52afb629e355 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db65036-8cc5-4350-8c63-75f13689d7fd]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] <== disconnect_volume: return (293ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updating instance_info_cache with network_info: [{"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Releasing lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Instance network_info: |[{"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4cc2e6a6-14a0-4962-9d9a-b89bf727a2b5 req-928d97b2-201e-4b04-a403-1a88a8a33cf5 service nova] Acquired lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-4cc2e6a6-14a0-4962-9d9a-b89bf727a2b5 req-928d97b2-201e-4b04-a403-1a88a8a33cf5 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Refreshing network info cache for port d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Start _get_guest_xml network_info=[{"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:20:33 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:20:33 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'flavor' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-962543650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-962543650',id=29,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-050x3wa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:20:31Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=31137824-5fa9-44e3-86ca-5d0587c28454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:78,bridge_name='br-int',has_traffic_filtering=True,id=d69de54a-f521-4ad2-95cc-b62e0dc878f1,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de54a-f5') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'pci_devices' on Instance uuid 31137824-5fa9-44e3-86ca-5d0587c28454 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:20:33 user nova-compute[74681]:   <uuid>31137824-5fa9-44e3-86ca-5d0587c28454</uuid>
Aug 16 06:20:33 user nova-compute[74681]:   <name>instance-0000001d</name>
Aug 16 06:20:33 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:20:33 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:20:33 user nova-compute[74681]:   <metadata>
Aug 16 06:20:33 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:20:33 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:20:33 user nova-compute[74681]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-962543650</nova:name>
Aug 16 06:20:33 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:20:33</nova:creationTime>
Aug 16 06:20:33 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:20:33 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:20:33 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:20:33 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:20:33 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:20:33 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:20:33 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:20:33 user nova-compute[74681]:       <nova:owner>
Aug 16 06:20:33 user nova-compute[74681]:         <nova:user uuid="361d070042c54dd59f7179619de1d1e9">tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member</nova:user>
Aug 16 06:20:33 user nova-compute[74681]:         <nova:project uuid="d289f0a66d5047b7b1be8ca5d969eaea">tempest-ServerBootFromVolumeStableRescueTest-2074839932</nova:project>
Aug 16 06:20:33 user nova-compute[74681]:       </nova:owner>
Aug 16 06:20:33 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:20:33 user nova-compute[74681]:       <nova:ports>
Aug 16 06:20:33 user nova-compute[74681]:         <nova:port uuid="d69de54a-f521-4ad2-95cc-b62e0dc878f1">
Aug 16 06:20:33 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 06:20:33 user nova-compute[74681]:         </nova:port>
Aug 16 06:20:33 user nova-compute[74681]:       </nova:ports>
Aug 16 06:20:33 user nova-compute[74681]:     </nova:instance>
Aug 16 06:20:33 user nova-compute[74681]:   </metadata>
Aug 16 06:20:33 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:20:33 user nova-compute[74681]:     <system>
Aug 16 06:20:33 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:20:33 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:20:33 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:20:33 user nova-compute[74681]:       <entry name="serial">31137824-5fa9-44e3-86ca-5d0587c28454</entry>
Aug 16 06:20:33 user nova-compute[74681]:       <entry name="uuid">31137824-5fa9-44e3-86ca-5d0587c28454</entry>
Aug 16 06:20:33 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:20:33 user nova-compute[74681]:     </system>
Aug 16 06:20:33 user nova-compute[74681]:   </sysinfo>
Aug 16 06:20:33 user nova-compute[74681]:   <os>
Aug 16 06:20:33 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:20:33 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:20:33 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:20:33 user nova-compute[74681]:   </os>
Aug 16 06:20:33 user nova-compute[74681]:   <features>
Aug 16 06:20:33 user nova-compute[74681]:     <acpi/>
Aug 16 06:20:33 user nova-compute[74681]:     <apic/>
Aug 16 06:20:33 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:20:33 user nova-compute[74681]:   </features>
Aug 16 06:20:33 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:20:33 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:20:33 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:20:33 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:20:33 user nova-compute[74681]:   </clock>
Aug 16 06:20:33 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:20:33 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:20:33 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:20:33 user nova-compute[74681]:   </cpu>
Aug 16 06:20:33 user nova-compute[74681]:   <devices>
Aug 16 06:20:33 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:20:33 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:20:33 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk"/>
Aug 16 06:20:33 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:20:33 user nova-compute[74681]:     </disk>
Aug 16 06:20:33 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:20:33 user nova-compute[74681]:       <mac address="fa:16:3e:f6:25:78"/>
Aug 16 06:20:33 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:20:33 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:20:33 user nova-compute[74681]:       <target dev="tapd69de54a-f5"/>
Aug 16 06:20:33 user nova-compute[74681]:     </interface>
Aug 16 06:20:33 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:20:33 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/console.log" append="off"/>
Aug 16 06:20:33 user nova-compute[74681]:     </serial>
Aug 16 06:20:33 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:20:33 user nova-compute[74681]:     <video>
Aug 16 06:20:33 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:20:33 user nova-compute[74681]:     </video>
Aug 16 06:20:33 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:20:33 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:20:33 user nova-compute[74681]:     </rng>
Aug 16 06:20:33 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:20:33 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:20:33 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:20:33 user nova-compute[74681]:     </memballoon>
Aug 16 06:20:33 user nova-compute[74681]:   </devices>
Aug 16 06:20:33 user nova-compute[74681]: </domain>
Aug 16 06:20:33 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-962543650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-962543650',id=29,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-050x3wa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:20:31Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=31137824-5fa9-44e3-86ca-5d0587c28454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:78,bridge_name='br-int',has_traffic_filtering=True,id=d69de54a-f521-4ad2-95cc-b62e0dc878f1,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de54a-f5') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG os_vif [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:78,bridge_name='br-int',has_traffic_filtering=True,id=d69de54a-f521-4ad2-95cc-b62e0dc878f1,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de54a-f5') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd69de54a-f5, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd69de54a-f5, col_values=(('external_ids', {'iface-id': 'd69de54a-f521-4ad2-95cc-b62e0dc878f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:25:78', 'vm-uuid': '31137824-5fa9-44e3-86ca-5d0587c28454'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:20:33 user nova-compute[74681]: INFO os_vif [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:25:78,bridge_name='br-int',has_traffic_filtering=True,id=d69de54a-f521-4ad2-95cc-b62e0dc878f1,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de54a-f5')
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No VIF found with MAC fa:16:3e:f6:25:78, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:20:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Creating image(s)
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "/opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "/opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "/opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.policy [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de61ce701f0b41fdb80225fc0ff05fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c0bd15a5644f4f92453e4706aef46d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:34 user nova-compute[74681]: INFO nova.compute.manager [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Attaching volume 7aff920c-4261-4e2f-9f3a-90c8c57847f5 to /dev/vdb
Aug 16 06:20:34 user nova-compute[74681]: DEBUG os_brick.utils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'flavor' on Instance uuid a95646fe-8d93-47c7-9590-dbbb54c479d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada2ab2b-1bc7-48a0-833d-18f16764fdb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d861db-ab70-4019-b921-db655e5d3bc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0550a27a-8829-4a25-ad0f-c8ecdc46c5a3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.805s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1573d5d7-f8b0-4ef1-b262-b0a3eb12078d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec400a7-914b-459b-8baa-61df145dd8ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-4cc2e6a6-14a0-4962-9d9a-b89bf727a2b5 req-928d97b2-201e-4b04-a403-1a88a8a33cf5 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updated VIF entry in instance network info cache for port d69de54a-f521-4ad2-95cc-b62e0dc878f1. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-4cc2e6a6-14a0-4962-9d9a-b89bf727a2b5 req-928d97b2-201e-4b04-a403-1a88a8a33cf5 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updating instance_info_cache with network_info: [{"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:34 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[655faff2-5a50-4cf4-90da-1a6e26bd471d]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4cc2e6a6-14a0-4962-9d9a-b89bf727a2b5 req-928d97b2-201e-4b04-a403-1a88a8a33cf5 service nova] Releasing lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG os_brick.utils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== get_connector_properties: return (246ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updating existing volume attachment record: bb1fb9fd-d40f-41b0-b7f0-2aa76ab77767 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk 1073741824" returned: 0 in 0.069s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-28030477-78b3-4944-b7ab-a4e1d74a047d req-4c554dfb-28df-444c-9ac7-63535429449f service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updated VIF entry in instance network info cache for port a2b31ee4-02ef-4ce4-87a1-8901f392593f. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-28030477-78b3-4944-b7ab-a4e1d74a047d req-4c554dfb-28df-444c-9ac7-63535429449f service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updating instance_info_cache with network_info: [{"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-28030477-78b3-4944-b7ab-a4e1d74a047d req-4c554dfb-28df-444c-9ac7-63535429449f service nova] Releasing lock "refresh_cache-6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Cannot resize image /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.objects.instance [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'migration_context' on Instance uuid 22008167-5859-402a-88fb-13b14bd6f48f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Ensure instance console log exists: /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG nova.network.neutron [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Successfully created port: d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuAqbiUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:35 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:35 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:35 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f75b488-fd5e-4d0b-ac25-26dc988a84bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:20:35 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1a573c-1832-4841-8040-6822081b16d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1] added
Aug 16 06:20:35 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8377860-e1e9-4bc6-be43-d0a788bb8225]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b8313e-ce94-4a5b-bf41-c4bb37de3d6f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OuAqbiUV {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OuAqbiUV" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046cde0-be22-4d56-a305-aec929458369]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OuAqbiUV'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8a877-759d-4f1f-bbf6-e62fe5cdd004]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[65337240-8308-40e4-b5ff-b9479bdb4638]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:35 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:35 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da1bb36-27ca-44a0-8b14-2591201e6032]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1, portal: 172.16.0.220,3260]
Aug 16 06:20:35 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1, portal: 172.16.0.220,3260] successful.
Aug 16 06:20:35 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-cf171fe2-e35e-4067-840b-7d73a18db383 req-34bec04e-c570-4dcb-9a49-f8d4dc03bab4 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received event network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cf171fe2-e35e-4067-840b-7d73a18db383 req-34bec04e-c570-4dcb-9a49-f8d4dc03bab4 service nova] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cf171fe2-e35e-4067-840b-7d73a18db383 req-34bec04e-c570-4dcb-9a49-f8d4dc03bab4 service nova] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cf171fe2-e35e-4067-840b-7d73a18db383 req-34bec04e-c570-4dcb-9a49-f8d4dc03bab4 service nova] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-cf171fe2-e35e-4067-840b-7d73a18db383 req-34bec04e-c570-4dcb-9a49-f8d4dc03bab4 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] No waiting events found dispatching network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:35 user nova-compute[74681]: WARNING nova.compute.manager [req-cf171fe2-e35e-4067-840b-7d73a18db383 req-34bec04e-c570-4dcb-9a49-f8d4dc03bab4 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received unexpected event network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 for instance with vm_state building and task_state spawning.
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5c17b-ff99-42af-be14-5bd3c09c8bbe]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1044a-8c41-468f-9204-70c4ace1ff3e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:35 user nova-compute[74681]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 (non-flash)
Aug 16 06:20:35 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:35 user nova-compute[74681]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 (non-flash)
Aug 16 06:20:35 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[254cdd73-cc20-4dec-a456-3660c2cb29fd]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:20:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuAqbiUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Successfully updated port: d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquired lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-2065706e-8ff8-4ea8-8f30-e7b710e483b1 req-ecd9e04f-1cfd-416f-b3ba-c9141788616d service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received event network-changed-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-2065706e-8ff8-4ea8-8f30-e7b710e483b1 req-ecd9e04f-1cfd-416f-b3ba-c9141788616d service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Refreshing instance network info cache due to event network-changed-d997a09b-599b-4ba7-b9dd-86a654901271. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2065706e-8ff8-4ea8-8f30-e7b710e483b1 req-ecd9e04f-1cfd-416f-b3ba-c9141788616d service nova] Acquiring lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Updating instance_info_cache with network_info: [{"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Releasing lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Instance network_info: |[{"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2065706e-8ff8-4ea8-8f30-e7b710e483b1 req-ecd9e04f-1cfd-416f-b3ba-c9141788616d service nova] Acquired lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.neutron [req-2065706e-8ff8-4ea8-8f30-e7b710e483b1 req-ecd9e04f-1cfd-416f-b3ba-c9141788616d service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Refreshing network info cache for port d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Start _get_guest_xml network_info=[{"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:20:36 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:20:36 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1673300292',display_name='tempest-AttachVolumeNegativeTest-server-1673300292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1673300292',id=30,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdKV+3E3jKMSfyqAK1qUNBNamtKMs57lfZoncoHXJc8iKZogWlw9Qb64lemR6aDVS3e8jzqB7EBmxnhUjsMakgbjT7trL6QEKH0cNsNRaBb2quLQjPLG/5HRcTOsL2u/A==',key_name='tempest-keypair-1653948621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-kbxinwc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=22008167-5859-402a-88fb-13b14bd6f48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=d997a09b-599b-4ba7-b9dd-86a654901271,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd997a09b-59') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.objects.instance [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'pci_devices' on Instance uuid 22008167-5859-402a-88fb-13b14bd6f48f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:20:36 user nova-compute[74681]:   <uuid>22008167-5859-402a-88fb-13b14bd6f48f</uuid>
Aug 16 06:20:36 user nova-compute[74681]:   <name>instance-0000001e</name>
Aug 16 06:20:36 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:20:36 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:20:36 user nova-compute[74681]:   <metadata>
Aug 16 06:20:36 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:20:36 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:20:36 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1673300292</nova:name>
Aug 16 06:20:36 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:20:36</nova:creationTime>
Aug 16 06:20:36 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:20:36 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:20:36 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:20:36 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:20:36 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:20:36 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:20:36 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:20:36 user nova-compute[74681]:       <nova:owner>
Aug 16 06:20:36 user nova-compute[74681]:         <nova:user uuid="de61ce701f0b41fdb80225fc0ff05fac">tempest-AttachVolumeNegativeTest-1322537387-project-member</nova:user>
Aug 16 06:20:36 user nova-compute[74681]:         <nova:project uuid="74c0bd15a5644f4f92453e4706aef46d">tempest-AttachVolumeNegativeTest-1322537387</nova:project>
Aug 16 06:20:36 user nova-compute[74681]:       </nova:owner>
Aug 16 06:20:36 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:20:36 user nova-compute[74681]:       <nova:ports>
Aug 16 06:20:36 user nova-compute[74681]:         <nova:port uuid="d997a09b-599b-4ba7-b9dd-86a654901271">
Aug 16 06:20:36 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 06:20:36 user nova-compute[74681]:         </nova:port>
Aug 16 06:20:36 user nova-compute[74681]:       </nova:ports>
Aug 16 06:20:36 user nova-compute[74681]:     </nova:instance>
Aug 16 06:20:36 user nova-compute[74681]:   </metadata>
Aug 16 06:20:36 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:20:36 user nova-compute[74681]:     <system>
Aug 16 06:20:36 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:20:36 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:20:36 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:20:36 user nova-compute[74681]:       <entry name="serial">22008167-5859-402a-88fb-13b14bd6f48f</entry>
Aug 16 06:20:36 user nova-compute[74681]:       <entry name="uuid">22008167-5859-402a-88fb-13b14bd6f48f</entry>
Aug 16 06:20:36 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:20:36 user nova-compute[74681]:     </system>
Aug 16 06:20:36 user nova-compute[74681]:   </sysinfo>
Aug 16 06:20:36 user nova-compute[74681]:   <os>
Aug 16 06:20:36 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:20:36 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:20:36 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:20:36 user nova-compute[74681]:   </os>
Aug 16 06:20:36 user nova-compute[74681]:   <features>
Aug 16 06:20:36 user nova-compute[74681]:     <acpi/>
Aug 16 06:20:36 user nova-compute[74681]:     <apic/>
Aug 16 06:20:36 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:20:36 user nova-compute[74681]:   </features>
Aug 16 06:20:36 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:20:36 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:20:36 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:20:36 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:20:36 user nova-compute[74681]:   </clock>
Aug 16 06:20:36 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:20:36 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:20:36 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:20:36 user nova-compute[74681]:   </cpu>
Aug 16 06:20:36 user nova-compute[74681]:   <devices>
Aug 16 06:20:36 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:20:36 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:20:36 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk"/>
Aug 16 06:20:36 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:20:36 user nova-compute[74681]:     </disk>
Aug 16 06:20:36 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:20:36 user nova-compute[74681]:       <mac address="fa:16:3e:07:ea:da"/>
Aug 16 06:20:36 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:20:36 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:20:36 user nova-compute[74681]:       <target dev="tapd997a09b-59"/>
Aug 16 06:20:36 user nova-compute[74681]:     </interface>
Aug 16 06:20:36 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:20:36 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/console.log" append="off"/>
Aug 16 06:20:36 user nova-compute[74681]:     </serial>
Aug 16 06:20:36 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:20:36 user nova-compute[74681]:     <video>
Aug 16 06:20:36 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:20:36 user nova-compute[74681]:     </video>
Aug 16 06:20:36 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:20:36 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:20:36 user nova-compute[74681]:     </rng>
Aug 16 06:20:36 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:20:36 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:20:36 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:20:36 user nova-compute[74681]:     </memballoon>
Aug 16 06:20:36 user nova-compute[74681]:   </devices>
Aug 16 06:20:36 user nova-compute[74681]: </domain>
Aug 16 06:20:36 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1673300292',display_name='tempest-AttachVolumeNegativeTest-server-1673300292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1673300292',id=30,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdKV+3E3jKMSfyqAK1qUNBNamtKMs57lfZoncoHXJc8iKZogWlw9Qb64lemR6aDVS3e8jzqB7EBmxnhUjsMakgbjT7trL6QEKH0cNsNRaBb2quLQjPLG/5HRcTOsL2u/A==',key_name='tempest-keypair-1653948621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-kbxinwc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:20:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=22008167-5859-402a-88fb-13b14bd6f48f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=d997a09b-599b-4ba7-b9dd-86a654901271,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd997a09b-59') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG os_vif [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=d997a09b-599b-4ba7-b9dd-86a654901271,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd997a09b-59') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23835656264353133', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835656264353133', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd997a09b-59, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd997a09b-59, col_values=(('external_ids', {'iface-id': 'd997a09b-599b-4ba7-b9dd-86a654901271', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:ea:da', 'vm-uuid': '22008167-5859-402a-88fb-13b14bd6f48f'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'flavor' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:36 user nova-compute[74681]: INFO os_vif [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=d997a09b-599b-4ba7-b9dd-86a654901271,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd997a09b-59')
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:20:36 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:36 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:20:36 user nova-compute[74681]:   <target dev="vdc" bus="virtio"/>
Aug 16 06:20:36 user nova-compute[74681]:   <serial>ac31e238-61f5-425c-86c3-96493f1135a1</serial>
Aug 16 06:20:36 user nova-compute[74681]: </disk>
Aug 16 06:20:36 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No VIF found with MAC fa:16:3e:07:ea:da, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.network.neutron [req-2065706e-8ff8-4ea8-8f30-e7b710e483b1 req-ecd9e04f-1cfd-416f-b3ba-c9141788616d service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Updated VIF entry in instance network info cache for port d997a09b-599b-4ba7-b9dd-86a654901271. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.network.neutron [req-2065706e-8ff8-4ea8-8f30-e7b710e483b1 req-ecd9e04f-1cfd-416f-b3ba-c9141788616d service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Updating instance_info_cache with network_info: [{"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2065706e-8ff8-4ea8-8f30-e7b710e483b1 req-ecd9e04f-1cfd-416f-b3ba-c9141788616d service nova] Releasing lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] No VIF found with MAC fa:16:3e:cf:89:fd, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e289d2c-c271-44ee-9e5e-1260f2c876ab tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.323s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166837.5839984, 31137824-5fa9-44e3-86ca-5d0587c28454 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:20:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] VM Resumed (Lifecycle Event)
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:20:37 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Instance spawned successfully.
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166837.5950065, 31137824-5fa9-44e3-86ca-5d0587c28454 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:20:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] VM Started (Lifecycle Event)
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-3e838e9b-bcf4-49f2-a55c-20837c527e38 req-5b99df48-e3ca-463c-a97f-a78d1890bd57 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received event network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3e838e9b-bcf4-49f2-a55c-20837c527e38 req-5b99df48-e3ca-463c-a97f-a78d1890bd57 service nova] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3e838e9b-bcf4-49f2-a55c-20837c527e38 req-5b99df48-e3ca-463c-a97f-a78d1890bd57 service nova] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3e838e9b-bcf4-49f2-a55c-20837c527e38 req-5b99df48-e3ca-463c-a97f-a78d1890bd57 service nova] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-3e838e9b-bcf4-49f2-a55c-20837c527e38 req-5b99df48-e3ca-463c-a97f-a78d1890bd57 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] No waiting events found dispatching network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:37 user nova-compute[74681]: WARNING nova.compute.manager [req-3e838e9b-bcf4-49f2-a55c-20837c527e38 req-5b99df48-e3ca-463c-a97f-a78d1890bd57 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received unexpected event network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 for instance with vm_state building and task_state spawning.
Aug 16 06:20:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:20:37 user nova-compute[74681]: INFO nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 16 06:20:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:37 user nova-compute[74681]: INFO nova.compute.manager [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Took 7.28 seconds to build instance.
Aug 16 06:20:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-44a8f3b4-66b5-49cd-8d14-b8bc72258c40 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "31137824-5fa9-44e3-86ca-5d0587c28454" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.405s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] There are 1 instances to clean {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance has had 1 of 5 cleanup attempts {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11142}}
Aug 16 06:20:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Deletion of /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize failed
Aug 16 06:20:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:38 user nova-compute[74681]: INFO nova.compute.manager [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Detaching volume ac31e238-61f5-425c-86c3-96493f1135a1
Aug 16 06:20:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:38 user nova-compute[74681]: INFO nova.virt.block_device [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Attempting to driver detach volume ac31e238-61f5-425c-86c3-96493f1135a1 from mountpoint /dev/vdc
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Attempting to detach device vdc from instance ee235b33-937c-41f4-9052-fc7f9f200cbe from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:20:38 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:38 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:20:38 user nova-compute[74681]:   <target dev="vdc" bus="virtio"/>
Aug 16 06:20:38 user nova-compute[74681]:   <serial>ac31e238-61f5-425c-86c3-96493f1135a1</serial>
Aug 16 06:20:38 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 06:20:38 user nova-compute[74681]: </disk>
Aug 16 06:20:38 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:20:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Successfully detached device vdc from instance ee235b33-937c-41f4-9052-fc7f9f200cbe from the persistent domain config.
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ee235b33-937c-41f4-9052-fc7f9f200cbe from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:20:38 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:38 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:20:38 user nova-compute[74681]:   <target dev="vdc" bus="virtio"/>
Aug 16 06:20:38 user nova-compute[74681]:   <serial>ac31e238-61f5-425c-86c3-96493f1135a1</serial>
Aug 16 06:20:38 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 06:20:38 user nova-compute[74681]: </disk>
Aug 16 06:20:38 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-400f47af-1763-427c-a44a-3f4c4bac8719 req-fceafb14-f9ce-4552-945e-ca6c17966046 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received event network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-400f47af-1763-427c-a44a-3f4c4bac8719 req-fceafb14-f9ce-4552-945e-ca6c17966046 service nova] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-400f47af-1763-427c-a44a-3f4c4bac8719 req-fceafb14-f9ce-4552-945e-ca6c17966046 service nova] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-400f47af-1763-427c-a44a-3f4c4bac8719 req-fceafb14-f9ce-4552-945e-ca6c17966046 service nova] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-400f47af-1763-427c-a44a-3f4c4bac8719 req-fceafb14-f9ce-4552-945e-ca6c17966046 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] No waiting events found dispatching network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:38 user nova-compute[74681]: WARNING nova.compute.manager [req-400f47af-1763-427c-a44a-3f4c4bac8719 req-fceafb14-f9ce-4552-945e-ca6c17966046 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received unexpected event network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 for instance with vm_state building and task_state spawning.
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "9662557e-2e89-42a0-9f0d-2189f84eece6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:39 user nova-compute[74681]: INFO nova.compute.manager [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Terminating instance
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166839.2596824, ee235b33-937c-41f4-9052-fc7f9f200cbe => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:20:39 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Successfully detached device vdc from instance ee235b33-937c-41f4-9052-fc7f9f200cbe from the live domain config.
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OuAqbiUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:39 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e63b75-f708-423e-8758-907e4b0a2f04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f997ea04-d0fd-4837-a669-ff84f9a297e9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:39 user nova-compute[74681]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 (non-flash)
Aug 16 06:20:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:39 user nova-compute[74681]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 (non-flash)
Aug 16 06:20:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94a1dcfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6ec4a1-3ac9-4037-ab97-33bd77a44233]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7595f7c-34b9-4983-83db-489a42c215e7]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[75afe563-b20f-4be8-a2b7-0485bd7a446e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a54fcc-0096-4ac9-ba6b-6cedf3655bd5]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[840bd2d0-aa12-4633-b0ec-fca814b55351]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f02062-1a59-417b-b4bf-82c37ddb5fcb]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1, portal: 172.16.0.220,3260]
Aug 16 06:20:39 user nova-compute[74681]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1, portal: 172.16.0.220,3260] successful.
Aug 16 06:20:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac31e238-61f5-425c-86c3-96493f1135a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbab6a48-bfe0-43b5-a7d0-dfc7ced32861]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] <== disconnect_volume: return (345ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updating instance_info_cache with network_info: [{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-f738d75b-b1b3-4e7e-b375-cb1c26591e91 req-8b5e1e93-9401-45d2-904d-135ca458a27d service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received event network-vif-unplugged-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f738d75b-b1b3-4e7e-b375-cb1c26591e91 req-8b5e1e93-9401-45d2-904d-135ca458a27d service nova] Acquiring lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f738d75b-b1b3-4e7e-b375-cb1c26591e91 req-8b5e1e93-9401-45d2-904d-135ca458a27d service nova] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f738d75b-b1b3-4e7e-b375-cb1c26591e91 req-8b5e1e93-9401-45d2-904d-135ca458a27d service nova] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-f738d75b-b1b3-4e7e-b375-cb1c26591e91 req-8b5e1e93-9401-45d2-904d-135ca458a27d service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] No waiting events found dispatching network-vif-unplugged-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-f738d75b-b1b3-4e7e-b375-cb1c26591e91 req-8b5e1e93-9401-45d2-904d-135ca458a27d service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received event network-vif-unplugged-256a200b-7264-4f81-803d-5d48e6156734 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Instance destroyed successfully.
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lazy-loading 'resources' on Instance uuid 9662557e-2e89-42a0-9f0d-2189f84eece6 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-633812485',display_name='tempest-VolumesActionsTest-instance-633812485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-633812485',id=26,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:18:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b1f3324efa34f56bab9b32dff44ac74',ramdisk_id='',reservation_id='r-i9sp18g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-13411155',owner_user_name='tempest-VolumesActionsTest-13411155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:18:56Z,user_data=None,user_id='597807248b8f4c598235cf07b48d1de5',uuid=9662557e-2e89-42a0-9f0d-2189f84eece6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converting VIF {"id": "256a200b-7264-4f81-803d-5d48e6156734", "address": "fa:16:3e:83:66:a0", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap256a200b-72", "ovs_interfaceid": "256a200b-7264-4f81-803d-5d48e6156734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=256a200b-7264-4f81-803d-5d48e6156734,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256a200b-72') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG os_vif [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=256a200b-7264-4f81-803d-5d48e6156734,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256a200b-72') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap256a200b-72, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:40 user nova-compute[74681]: INFO os_vif [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:66:a0,bridge_name='br-int',has_traffic_filtering=True,id=256a200b-7264-4f81-803d-5d48e6156734,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap256a200b-72')
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Deleting instance files /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6_del
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Deletion of /opt/stack/data/nova/instances/9662557e-2e89-42a0-9f0d-2189f84eece6_del complete
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.compute.manager [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Took 0.63 seconds to deallocate network for instance.
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-ed07b86e-81fa-453d-8b5c-6ff88dc88a2c req-ae85f349-3c95-4607-acf7-c51ca555e19e service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received event network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ed07b86e-81fa-453d-8b5c-6ff88dc88a2c req-ae85f349-3c95-4607-acf7-c51ca555e19e service nova] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ed07b86e-81fa-453d-8b5c-6ff88dc88a2c req-ae85f349-3c95-4607-acf7-c51ca555e19e service nova] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ed07b86e-81fa-453d-8b5c-6ff88dc88a2c req-ae85f349-3c95-4607-acf7-c51ca555e19e service nova] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-ed07b86e-81fa-453d-8b5c-6ff88dc88a2c req-ae85f349-3c95-4607-acf7-c51ca555e19e service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] No waiting events found dispatching network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:40 user nova-compute[74681]: WARNING nova.compute.manager [req-ed07b86e-81fa-453d-8b5c-6ff88dc88a2c req-ae85f349-3c95-4607-acf7-c51ca555e19e service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received unexpected event network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 for instance with vm_state building and task_state spawning.
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-6209855c-9451-48eb-95ae-60fd5462297d req-42821acf-53a5-45ac-a211-2a2bd11fecfc service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received event network-vif-deleted-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.compute.manager [req-6209855c-9451-48eb-95ae-60fd5462297d req-42821acf-53a5-45ac-a211-2a2bd11fecfc service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Neutron deleted interface 256a200b-7264-4f81-803d-5d48e6156734; detaching it from the instance and deleting it from the info cache
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.network.neutron [req-6209855c-9451-48eb-95ae-60fd5462297d req-42821acf-53a5-45ac-a211-2a2bd11fecfc service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-6209855c-9451-48eb-95ae-60fd5462297d req-42821acf-53a5-45ac-a211-2a2bd11fecfc service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Detach interface failed, port_id=256a200b-7264-4f81-803d-5d48e6156734, reason: Instance 9662557e-2e89-42a0-9f0d-2189f84eece6 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166840.9047632, 22008167-5859-402a-88fb-13b14bd6f48f => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] VM Resumed (Lifecycle Event)
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Instance spawned successfully.
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166840.9051251, 22008167-5859-402a-88fb-13b14bd6f48f => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:20:40 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] VM Started (Lifecycle Event)
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:20:41 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:20:41 user nova-compute[74681]: INFO nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 16 06:20:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:41 user nova-compute[74681]: INFO nova.compute.manager [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Took 8.26 seconds to build instance.
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-15eb4907-4f41-4145-bf65-1be16b348337 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.364s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.628s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.445s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:20:41 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Deleted allocations for instance 9662557e-2e89-42a0-9f0d-2189f84eece6
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d67ba048-1b34-46e7-95ae-9a4c2bd3984c tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.514s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-b19c68e8-f84c-4eef-bc26-01219bc2c1fd req-66157685-b1cd-4900-a1e7-432036d321c3 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received event network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b19c68e8-f84c-4eef-bc26-01219bc2c1fd req-66157685-b1cd-4900-a1e7-432036d321c3 service nova] Acquiring lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b19c68e8-f84c-4eef-bc26-01219bc2c1fd req-66157685-b1cd-4900-a1e7-432036d321c3 service nova] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b19c68e8-f84c-4eef-bc26-01219bc2c1fd req-66157685-b1cd-4900-a1e7-432036d321c3 service nova] Lock "9662557e-2e89-42a0-9f0d-2189f84eece6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-b19c68e8-f84c-4eef-bc26-01219bc2c1fd req-66157685-b1cd-4900-a1e7-432036d321c3 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] No waiting events found dispatching network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:42 user nova-compute[74681]: WARNING nova.compute.manager [req-b19c68e8-f84c-4eef-bc26-01219bc2c1fd req-66157685-b1cd-4900-a1e7-432036d321c3 service nova] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Received unexpected event network-vif-plugged-256a200b-7264-4f81-803d-5d48e6156734 for instance with vm_state deleted and task_state None.
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:43 user nova-compute[74681]: INFO nova.compute.manager [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Rescuing
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquired lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG nova.objects.instance [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'flavor' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-895a8530-3b10-4abd-a93f-b54459f500ee tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.113s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updating instance_info_cache with network_info: [{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:20:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Releasing lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-787080f9-3aeb-4983-9bbe-2dbe6cd50e29 req-ca9c61e7-cbbd-45b4-b79a-dce5c1079aac service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-787080f9-3aeb-4983-9bbe-2dbe6cd50e29 req-ca9c61e7-cbbd-45b4-b79a-dce5c1079aac service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-787080f9-3aeb-4983-9bbe-2dbe6cd50e29 req-ca9c61e7-cbbd-45b4-b79a-dce5c1079aac service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-787080f9-3aeb-4983-9bbe-2dbe6cd50e29 req-ca9c61e7-cbbd-45b4-b79a-dce5c1079aac service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-787080f9-3aeb-4983-9bbe-2dbe6cd50e29 req-ca9c61e7-cbbd-45b4-b79a-dce5c1079aac service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:44 user nova-compute[74681]: WARNING nova.compute.manager [req-787080f9-3aeb-4983-9bbe-2dbe6cd50e29 req-ca9c61e7-cbbd-45b4-b79a-dce5c1079aac service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state active and task_state rescuing.
Aug 16 06:20:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvkVfBqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:44 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:44 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:44 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a35ca49-71b3-4e81-b548-eadde80bb9f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:20:44 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c1ee6b-71d6-4877-99c8-a19f1880f4e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5] added
Aug 16 06:20:44 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance destroyed successfully.
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Attempting rescue
Aug 16 06:20:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74681) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance directory exists: not creating {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 06:20:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Creating image(s)
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6308793-a186-499b-9fd9-448fb5066da3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[59685b84-0b22-4f2b-8f43-0b7f8a45df27]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvkVfBqj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvkVfBqj" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[747ec7cb-5a25-4b92-991a-1fefa2585807]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvkVfBqj'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.rescue {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.140s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cf8d11-8f6f-4286-8f98-2855269b69d6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80a3d8f-c37c-418b-bc14-8ee262724b0b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.rescue" returned: 0 in 0.139s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'migration_context' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Start _get_guest_xml network_info=[{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:ec:46:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'resources' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'numa_topology' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d1930-28ce-4231-b795-a10dbe5af914]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260]
Aug 16 06:20:45 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260] successful.
Aug 16 06:20:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:20:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d35a27a-c2db-4eb8-af8e-224febf5887c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-933932228',display_name='tempest-ServerRescueNegativeTestJSON-server-933932228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-933932228',id=19,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:16:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-kv2gn6id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:16:05Z,user_data=None,user_id='830eea7441aa4c928dcb598a555e01cd',uuid=6485c0f0-71dd-48f3-b2fe-449e1770cda7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:ec:46:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:ec:46:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:46:54,bridge_name='br-int',has_traffic_filtering=True,id=470f841a-cded-42c7-968a-0fa5ef24ea55,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470f841a-cd') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'pci_devices' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15907cc-c164-4e46-ac81-3276bbeb7e64]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:45 user nova-compute[74681]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:20:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:45 user nova-compute[74681]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:20:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.603s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:20:45 user nova-compute[74681]:   <uuid>6485c0f0-71dd-48f3-b2fe-449e1770cda7</uuid>
Aug 16 06:20:45 user nova-compute[74681]:   <name>instance-00000013</name>
Aug 16 06:20:45 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:20:45 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:20:45 user nova-compute[74681]:   <metadata>
Aug 16 06:20:45 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:20:45 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:20:45 user nova-compute[74681]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-933932228</nova:name>
Aug 16 06:20:45 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:20:45</nova:creationTime>
Aug 16 06:20:45 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:20:45 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:20:45 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:20:45 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:20:45 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:20:45 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:20:45 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:20:45 user nova-compute[74681]:       <nova:owner>
Aug 16 06:20:45 user nova-compute[74681]:         <nova:user uuid="830eea7441aa4c928dcb598a555e01cd">tempest-ServerRescueNegativeTestJSON-472247401-project-member</nova:user>
Aug 16 06:20:45 user nova-compute[74681]:         <nova:project uuid="ce6d58d07b1145b493d5a07a40c1eb0c">tempest-ServerRescueNegativeTestJSON-472247401</nova:project>
Aug 16 06:20:45 user nova-compute[74681]:       </nova:owner>
Aug 16 06:20:45 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:20:45 user nova-compute[74681]:       <nova:ports>
Aug 16 06:20:45 user nova-compute[74681]:         <nova:port uuid="470f841a-cded-42c7-968a-0fa5ef24ea55">
Aug 16 06:20:45 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 06:20:45 user nova-compute[74681]:         </nova:port>
Aug 16 06:20:45 user nova-compute[74681]:       </nova:ports>
Aug 16 06:20:45 user nova-compute[74681]:     </nova:instance>
Aug 16 06:20:45 user nova-compute[74681]:   </metadata>
Aug 16 06:20:45 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:20:45 user nova-compute[74681]:     <system>
Aug 16 06:20:45 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:20:45 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:20:45 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:20:45 user nova-compute[74681]:       <entry name="serial">6485c0f0-71dd-48f3-b2fe-449e1770cda7</entry>
Aug 16 06:20:45 user nova-compute[74681]:       <entry name="uuid">6485c0f0-71dd-48f3-b2fe-449e1770cda7</entry>
Aug 16 06:20:45 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:20:45 user nova-compute[74681]:     </system>
Aug 16 06:20:45 user nova-compute[74681]:   </sysinfo>
Aug 16 06:20:45 user nova-compute[74681]:   <os>
Aug 16 06:20:45 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:20:45 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:20:45 user nova-compute[74681]:   </os>
Aug 16 06:20:45 user nova-compute[74681]:   <features>
Aug 16 06:20:45 user nova-compute[74681]:     <acpi/>
Aug 16 06:20:45 user nova-compute[74681]:     <apic/>
Aug 16 06:20:45 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:20:45 user nova-compute[74681]:   </features>
Aug 16 06:20:45 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:20:45 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:20:45 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:20:45 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:20:45 user nova-compute[74681]:   </clock>
Aug 16 06:20:45 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:20:45 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:20:45 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:20:45 user nova-compute[74681]:   </cpu>
Aug 16 06:20:45 user nova-compute[74681]:   <devices>
Aug 16 06:20:45 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:20:45 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:20:45 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.rescue"/>
Aug 16 06:20:45 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:20:45 user nova-compute[74681]:     </disk>
Aug 16 06:20:45 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:20:45 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:20:45 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk"/>
Aug 16 06:20:45 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:20:45 user nova-compute[74681]:     </disk>
Aug 16 06:20:45 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:20:45 user nova-compute[74681]:       <mac address="fa:16:3e:ec:46:54"/>
Aug 16 06:20:45 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:20:45 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:20:45 user nova-compute[74681]:       <target dev="tap470f841a-cd"/>
Aug 16 06:20:45 user nova-compute[74681]:     </interface>
Aug 16 06:20:45 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:20:45 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/console.log" append="off"/>
Aug 16 06:20:45 user nova-compute[74681]:     </serial>
Aug 16 06:20:45 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:20:45 user nova-compute[74681]:     <video>
Aug 16 06:20:45 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:20:45 user nova-compute[74681]:     </video>
Aug 16 06:20:45 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:20:45 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:20:45 user nova-compute[74681]:     </rng>
Aug 16 06:20:45 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:20:45 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:20:45 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:20:45 user nova-compute[74681]:     </memballoon>
Aug 16 06:20:45 user nova-compute[74681]:   </devices>
Aug 16 06:20:45 user nova-compute[74681]: </domain>
Aug 16 06:20:45 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b57150-f5c0-46c4-a072-28ac8f64bee9]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvkVfBqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:20:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance destroyed successfully.
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No VIF found with MAC fa:16:3e:ec:46:54, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-3c5d14c1-76e3-458a-8f9c-2144e4b96760 req-cf4c9169-9c2c-447c-b266-dab3efa42bd2 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3c5d14c1-76e3-458a-8f9c-2144e4b96760 req-cf4c9169-9c2c-447c-b266-dab3efa42bd2 service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3c5d14c1-76e3-458a-8f9c-2144e4b96760 req-cf4c9169-9c2c-447c-b266-dab3efa42bd2 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3c5d14c1-76e3-458a-8f9c-2144e4b96760 req-cf4c9169-9c2c-447c-b266-dab3efa42bd2 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-3c5d14c1-76e3-458a-8f9c-2144e4b96760 req-cf4c9169-9c2c-447c-b266-dab3efa42bd2 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:46 user nova-compute[74681]: WARNING nova.compute.manager [req-3c5d14c1-76e3-458a-8f9c-2144e4b96760 req-cf4c9169-9c2c-447c-b266-dab3efa42bd2 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state active and task_state rescuing.
Aug 16 06:20:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.685s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== connect_volume: return (1689ms) {'type': 'block', 'scsi_wwn': '26439386330623461', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439386330623461', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'flavor' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:20:46 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:46 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:20:46 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:20:46 user nova-compute[74681]:   <serial>7aff920c-4261-4e2f-9f3a-90c8c57847f5</serial>
Aug 16 06:20:46 user nova-compute[74681]: </disk>
Aug 16 06:20:46 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:20:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:49 user nova-compute[74681]: WARNING nova.compute.manager [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state active and task_state rescuing.
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:49 user nova-compute[74681]: WARNING nova.compute.manager [req-02023fb1-6412-4695-97c0-26ba3a75f8f7 req-59a521b0-9155-4844-91a6-6a434e95041e service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state active and task_state rescuing.
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-ce669c1d-36dd-4cf4-b8a2-01b16146c063 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for 6485c0f0-71dd-48f3-b2fe-449e1770cda7 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166849.4793682, 6485c0f0-71dd-48f3-b2fe-449e1770cda7 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:20:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] VM Resumed (Lifecycle Event)
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:20:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7336MB free_disk=25.441730499267578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No VIF found with MAC fa:16:3e:c6:c6:78, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166849.4797304, 6485c0f0-71dd-48f3-b2fe-449e1770cda7 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:20:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] VM Started (Lifecycle Event)
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ee235b33-937c-41f4-9052-fc7f9f200cbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a95646fe-8d93-47c7-9590-dbbb54c479d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ab220126-7cda-4787-96b5-4836eb31b18b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 22008167-5859-402a-88fb-13b14bd6f48f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:20:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34242043-12ff-4cc4-afbc-40a4d271ee7e tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.812s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing inventories for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating ProviderTree inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing aggregate associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, aggregates: None {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing trait associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.892s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74681) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:51 user nova-compute[74681]: INFO nova.compute.manager [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Rebuilding instance
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'resources' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'migration_context' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74681) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-12b37e33-7139-4a4d-a821-aa0c13fe8248 req-03be7792-e781-408b-8834-06987cb9f042 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-unplugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-12b37e33-7139-4a4d-a821-aa0c13fe8248 req-03be7792-e781-408b-8834-06987cb9f042 service nova] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-12b37e33-7139-4a4d-a821-aa0c13fe8248 req-03be7792-e781-408b-8834-06987cb9f042 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-12b37e33-7139-4a4d-a821-aa0c13fe8248 req-03be7792-e781-408b-8834-06987cb9f042 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-12b37e33-7139-4a4d-a821-aa0c13fe8248 req-03be7792-e781-408b-8834-06987cb9f042 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] No waiting events found dispatching network-vif-unplugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:51 user nova-compute[74681]: WARNING nova.compute.manager [req-12b37e33-7139-4a4d-a821-aa0c13fe8248 req-03be7792-e781-408b-8834-06987cb9f042 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received unexpected event network-vif-unplugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f for instance with vm_state active and task_state rebuilding.
Aug 16 06:20:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:52 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance destroyed successfully.
Aug 16 06:20:52 user nova-compute[74681]: INFO nova.compute.manager [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Detaching volume 7aff920c-4261-4e2f-9f3a-90c8c57847f5
Aug 16 06:20:52 user nova-compute[74681]: INFO nova.virt.block_device [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Attempting to driver detach volume 7aff920c-4261-4e2f-9f3a-90c8c57847f5 from mountpoint /dev/vdb
Aug 16 06:20:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Attempting to detach device vdb from instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:20:52 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:20:52 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:20:52 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:20:52 user nova-compute[74681]:   <serial>7aff920c-4261-4e2f-9f3a-90c8c57847f5</serial>
Aug 16 06:20:52 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:20:52 user nova-compute[74681]: </disk>
Aug 16 06:20:52 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:20:52 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully detached device vdb from instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 from the persistent domain config.
Aug 16 06:20:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvkVfBqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:52 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f17b8-5491-40bc-a708-dfd449791649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ee24c3-a578-45cf-abb4-1fbf1283483b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:52 user nova-compute[74681]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:20:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:52 user nova-compute[74681]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:20:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94940e8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f652e748-ce84-41ec-951a-7e29e3919642]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb637386-7f51-4fbd-b39a-125d3d4f96a8]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0f556-77d5-45d8-91a8-f23ee9e54821]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f2b26e-f7ce-40cf-8a1b-b4579ccaa4d9]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5ff0d2-7316-4a6b-8c9e-0bb434a85d76]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.199s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6f196c-b0ce-458e-8378-127c6e8d49d8]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260]
Aug 16 06:20:52 user nova-compute[74681]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260] successful.
Aug 16 06:20:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3538b71-4f73-47fa-bfbf-6f56f416d136]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== disconnect_volume: return (454ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:20:53 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance destroyed successfully.
Aug 16 06:20:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1387190709',display_name='tempest-ServerActionsTestOtherA-server-720646220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1387190709',id=25,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2L1ejR2vei5TDJOZbHSyBoxvQApT2+jkpRVZD90oKBxXOM2q1a3wTMe8Xu++AP0SDOe2Xi6a1YzF+6WIWoDKCBaZimySH7babwXR4TOSdLQ/i0QpfzTRR+mACQj56FfQ==',key_name='tempest-keypair-780374784',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-73tkjm38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_vif [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2b31ee4-02, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:20:53 user nova-compute[74681]: INFO os_vif [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02')
Aug 16 06:20:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvkVfBqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:53 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5f64d1-7fc1-46fa-87a9-8b3bfb870dfd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9832feeb-228d-46ae-9e54-50f9b1287895]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:20:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94a1dce950>, {}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Disconnecting from: [] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== disconnect_volume: return (50ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:20:53 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Deleting instance files /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7_del
Aug 16 06:20:53 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Deletion of /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7_del complete
Aug 16 06:20:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-ab178c8d-b2ea-4977-9308-cfc570a5756d req-c8489adf-165a-4abb-9fa9-08ac13a382b5 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab178c8d-b2ea-4977-9308-cfc570a5756d req-c8489adf-165a-4abb-9fa9-08ac13a382b5 service nova] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab178c8d-b2ea-4977-9308-cfc570a5756d req-c8489adf-165a-4abb-9fa9-08ac13a382b5 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab178c8d-b2ea-4977-9308-cfc570a5756d req-c8489adf-165a-4abb-9fa9-08ac13a382b5 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:20:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-ab178c8d-b2ea-4977-9308-cfc570a5756d req-c8489adf-165a-4abb-9fa9-08ac13a382b5 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] No waiting events found dispatching network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:20:53 user nova-compute[74681]: WARNING nova.compute.manager [req-ab178c8d-b2ea-4977-9308-cfc570a5756d req-c8489adf-165a-4abb-9fa9-08ac13a382b5 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received unexpected event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f for instance with vm_state active and task_state rebuilding.
Aug 16 06:20:53 user nova-compute[74681]: INFO nova.virt.block_device [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Booting with volume 7aff920c-4261-4e2f-9f3a-90c8c57847f5 at /dev/vdb
Aug 16 06:20:54 user nova-compute[74681]: DEBUG os_brick.utils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdb4bc5-dd32-4f9a-90b1-b2439e8c2ddf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2b1461-5532-4854-8b5a-4bd40ca1d9a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad67b9-e4e8-41aa-83e3-2624104fc626]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[201d3cf0-f886-4d67-9ec3-15687c6d7c8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:20:54 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:20:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0933d8-4dd6-433f-b908-278f190840aa]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG os_brick.utils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:20:54 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updating existing volume attachment record: 9cf937f5-93cf-4948-b32b-b7b8e4a92eb9 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:20:55 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166840.1098208, 9662557e-2e89-42a0-9f0d-2189f84eece6 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:20:55 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] VM Stopped (Lifecycle Event)
Aug 16 06:20:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-bf9d9372-b12c-477f-846f-6c8a9a440f00 None None] [instance: 9662557e-2e89-42a0-9f0d-2189f84eece6] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:20:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:20:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:21:03 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Creating image(s)
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk 1073741824" returned: 0 in 0.048s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Cannot resize image /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Ensure instance console log exists: /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Start _get_guest_xml network_info=[{"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '9cf937f5-93cf-4948-b32b-b7b8e4a92eb9', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvkVfBqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7', 'attached_at': '', 'detached_at': '', 'volume_id': '7aff920c-4261-4e2f-9f3a-90c8c57847f5', 'serial': '7aff920c-4261-4e2f-9f3a-90c8c57847f5'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:21:04 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 06:21:04 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvkVfBqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:21:04 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:21:04 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:21:04 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a91edc-7be0-490f-84a9-66fddffc325e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:21:04 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[851e3faa-ec85-42cf-9c64-37bd28ba0beb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5] added
Aug 16 06:21:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9ceaa3-46aa-40f4-ad5d-6196774f4088]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bcd1a0-156e-4fdc-b7ab-68b49227b934]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvkVfBqj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvkVfBqj" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ac8d42-e668-444e-80ed-bfd0dfbbf438]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvkVfBqj'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80d4bed-1853-4485-a123-f9148d8c4794]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a27219a-10fa-42d8-b6a8-b931ff52769b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:21:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:21:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1943d305-abac-429f-a1e4-9f179d0bbb8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260]
Aug 16 06:21:04 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260] successful.
Aug 16 06:21:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb1642c-f034-4a23-9a2a-2041a74ad928]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4be103-1dcb-42a1-a1dc-38153a871904]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:21:04 user nova-compute[74681]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:21:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:21:04 user nova-compute[74681]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:21:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14ba95-f5e5-43d3-bcf0-11f911724905]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:21:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvkVfBqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26439386330623461', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439386330623461', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1387190709',display_name='tempest-ServerActionsTestOtherA-server-720646220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1387190709',id=25,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2L1ejR2vei5TDJOZbHSyBoxvQApT2+jkpRVZD90oKBxXOM2q1a3wTMe8Xu++AP0SDOe2Xi6a1YzF+6WIWoDKCBaZimySH7babwXR4TOSdLQ/i0QpfzTRR+mACQj56FfQ==',key_name='tempest-keypair-780374784',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-73tkjm38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:21:05 user nova-compute[74681]:   <uuid>6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7</uuid>
Aug 16 06:21:05 user nova-compute[74681]:   <name>instance-00000019</name>
Aug 16 06:21:05 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:21:05 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:21:05 user nova-compute[74681]:   <metadata>
Aug 16 06:21:05 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:21:05 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:21:05 user nova-compute[74681]:       <nova:name>tempest-ServerActionsTestOtherA-server-720646220</nova:name>
Aug 16 06:21:05 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:21:04</nova:creationTime>
Aug 16 06:21:05 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:21:05 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:21:05 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:21:05 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:21:05 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:21:05 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:21:05 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:21:05 user nova-compute[74681]:       <nova:owner>
Aug 16 06:21:05 user nova-compute[74681]:         <nova:user uuid="790c60ee58a549ddaabd5f0badcb77fe">tempest-ServerActionsTestOtherA-2037182259-project-member</nova:user>
Aug 16 06:21:05 user nova-compute[74681]:         <nova:project uuid="845526507c1a4a9eadc6c45271cceb94">tempest-ServerActionsTestOtherA-2037182259</nova:project>
Aug 16 06:21:05 user nova-compute[74681]:       </nova:owner>
Aug 16 06:21:05 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:21:05 user nova-compute[74681]:       <nova:ports>
Aug 16 06:21:05 user nova-compute[74681]:         <nova:port uuid="a2b31ee4-02ef-4ce4-87a1-8901f392593f">
Aug 16 06:21:05 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 06:21:05 user nova-compute[74681]:         </nova:port>
Aug 16 06:21:05 user nova-compute[74681]:       </nova:ports>
Aug 16 06:21:05 user nova-compute[74681]:     </nova:instance>
Aug 16 06:21:05 user nova-compute[74681]:   </metadata>
Aug 16 06:21:05 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:21:05 user nova-compute[74681]:     <system>
Aug 16 06:21:05 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:21:05 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:21:05 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:21:05 user nova-compute[74681]:       <entry name="serial">6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7</entry>
Aug 16 06:21:05 user nova-compute[74681]:       <entry name="uuid">6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7</entry>
Aug 16 06:21:05 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:21:05 user nova-compute[74681]:     </system>
Aug 16 06:21:05 user nova-compute[74681]:   </sysinfo>
Aug 16 06:21:05 user nova-compute[74681]:   <os>
Aug 16 06:21:05 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:21:05 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:21:05 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:21:05 user nova-compute[74681]:   </os>
Aug 16 06:21:05 user nova-compute[74681]:   <features>
Aug 16 06:21:05 user nova-compute[74681]:     <acpi/>
Aug 16 06:21:05 user nova-compute[74681]:     <apic/>
Aug 16 06:21:05 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:21:05 user nova-compute[74681]:   </features>
Aug 16 06:21:05 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:21:05 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:21:05 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:21:05 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:21:05 user nova-compute[74681]:   </clock>
Aug 16 06:21:05 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:21:05 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:21:05 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:21:05 user nova-compute[74681]:   </cpu>
Aug 16 06:21:05 user nova-compute[74681]:   <devices>
Aug 16 06:21:05 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:21:05 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:21:05 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk"/>
Aug 16 06:21:05 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:21:05 user nova-compute[74681]:     </disk>
Aug 16 06:21:05 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:21:05 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:21:05 user nova-compute[74681]:       <source dev="/dev/sdc"/>
Aug 16 06:21:05 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:21:05 user nova-compute[74681]:       <serial>7aff920c-4261-4e2f-9f3a-90c8c57847f5</serial>
Aug 16 06:21:05 user nova-compute[74681]:     </disk>
Aug 16 06:21:05 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:21:05 user nova-compute[74681]:       <mac address="fa:16:3e:c6:c6:78"/>
Aug 16 06:21:05 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:21:05 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:21:05 user nova-compute[74681]:       <target dev="tapa2b31ee4-02"/>
Aug 16 06:21:05 user nova-compute[74681]:     </interface>
Aug 16 06:21:05 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:21:05 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/console.log" append="off"/>
Aug 16 06:21:05 user nova-compute[74681]:     </serial>
Aug 16 06:21:05 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:21:05 user nova-compute[74681]:     <video>
Aug 16 06:21:05 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:21:05 user nova-compute[74681]:     </video>
Aug 16 06:21:05 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:21:05 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:21:05 user nova-compute[74681]:     </rng>
Aug 16 06:21:05 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:21:05 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:21:05 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:21:05 user nova-compute[74681]:     </memballoon>
Aug 16 06:21:05 user nova-compute[74681]:   </devices>
Aug 16 06:21:05 user nova-compute[74681]: </domain>
Aug 16 06:21:05 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1387190709',display_name='tempest-ServerActionsTestOtherA-server-720646220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1387190709',id=25,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2L1ejR2vei5TDJOZbHSyBoxvQApT2+jkpRVZD90oKBxXOM2q1a3wTMe8Xu++AP0SDOe2Xi6a1YzF+6WIWoDKCBaZimySH7babwXR4TOSdLQ/i0QpfzTRR+mACQj56FfQ==',key_name='tempest-keypair-780374784',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:18:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-73tkjm38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG os_vif [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2b31ee4-02, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2b31ee4-02, col_values=(('external_ids', {'iface-id': 'a2b31ee4-02ef-4ce4-87a1-8901f392593f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:c6:78', 'vm-uuid': '6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:05 user nova-compute[74681]: INFO os_vif [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02')
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:21:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No VIF found with MAC fa:16:3e:c6:c6:78, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:21:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166852.2529216, 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:07 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] VM Stopped (Lifecycle Event)
Aug 16 06:21:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99e72ace-d171-467a-8476-54d742b2a8c6 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-33831afd-420a-45eb-af77-fb84ddbba5a5 req-17ade62d-409d-45f1-84b5-411c598db01e service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-33831afd-420a-45eb-af77-fb84ddbba5a5 req-17ade62d-409d-45f1-84b5-411c598db01e service nova] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-33831afd-420a-45eb-af77-fb84ddbba5a5 req-17ade62d-409d-45f1-84b5-411c598db01e service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-33831afd-420a-45eb-af77-fb84ddbba5a5 req-17ade62d-409d-45f1-84b5-411c598db01e service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-33831afd-420a-45eb-af77-fb84ddbba5a5 req-17ade62d-409d-45f1-84b5-411c598db01e service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] No waiting events found dispatching network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:07 user nova-compute[74681]: WARNING nova.compute.manager [req-33831afd-420a-45eb-af77-fb84ddbba5a5 req-17ade62d-409d-45f1-84b5-411c598db01e service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received unexpected event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f for instance with vm_state active and task_state rebuild_spawning.
Aug 16 06:21:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166869.3300562, 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:09 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] VM Resumed (Lifecycle Event)
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:21:09 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance spawned successfully.
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fa9acaa-8817-4ec6-8875-1f20b253e15e req-f1561c3a-5de1-4326-93be-fa102611cdee service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fa9acaa-8817-4ec6-8875-1f20b253e15e req-f1561c3a-5de1-4326-93be-fa102611cdee service nova] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fa9acaa-8817-4ec6-8875-1f20b253e15e req-f1561c3a-5de1-4326-93be-fa102611cdee service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4fa9acaa-8817-4ec6-8875-1f20b253e15e req-f1561c3a-5de1-4326-93be-fa102611cdee service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-4fa9acaa-8817-4ec6-8875-1f20b253e15e req-f1561c3a-5de1-4326-93be-fa102611cdee service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] No waiting events found dispatching network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:09 user nova-compute[74681]: WARNING nova.compute.manager [req-4fa9acaa-8817-4ec6-8875-1f20b253e15e req-f1561c3a-5de1-4326-93be-fa102611cdee service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received unexpected event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f for instance with vm_state active and task_state rebuild_spawning.
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:09 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166869.3339517, 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:09 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] VM Started (Lifecycle Event)
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:21:09 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74681) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 06:21:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dafcbe94-7124-4c75-8f32-f3d52d874fde tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "ab220126-7cda-4787-96b5-4836eb31b18b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "ab220126-7cda-4787-96b5-4836eb31b18b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:13 user nova-compute[74681]: INFO nova.compute.manager [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Terminating instance
Aug 16 06:21:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-42a1c23a-0dc2-4387-8e6b-f22663ffb3eb req-c8df3f67-cc4a-443b-8e67-1a6b3dc726da service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received event network-vif-unplugged-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-42a1c23a-0dc2-4387-8e6b-f22663ffb3eb req-c8df3f67-cc4a-443b-8e67-1a6b3dc726da service nova] Acquiring lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-42a1c23a-0dc2-4387-8e6b-f22663ffb3eb req-c8df3f67-cc4a-443b-8e67-1a6b3dc726da service nova] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-42a1c23a-0dc2-4387-8e6b-f22663ffb3eb req-c8df3f67-cc4a-443b-8e67-1a6b3dc726da service nova] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-42a1c23a-0dc2-4387-8e6b-f22663ffb3eb req-c8df3f67-cc4a-443b-8e67-1a6b3dc726da service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] No waiting events found dispatching network-vif-unplugged-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-42a1c23a-0dc2-4387-8e6b-f22663ffb3eb req-c8df3f67-cc4a-443b-8e67-1a6b3dc726da service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received event network-vif-unplugged-36166625-6cf3-49f4-8a01-8a85d7fded91 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:21:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Instance destroyed successfully.
Aug 16 06:21:14 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lazy-loading 'resources' on Instance uuid ab220126-7cda-4787-96b5-4836eb31b18b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1478008224',display_name='tempest-VolumesActionsTest-instance-1478008224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1478008224',id=27,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47fb12f1b9b84c128b9a9f5fcdb32c7d',ramdisk_id='',reservation_id='r-sc536iv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1652006769',owner_user_name='tempest-VolumesActionsTest-1652006769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:19:18Z,user_data=None,user_id='5a08f5511fea4a4399ea890af2e78807',uuid=ab220126-7cda-4787-96b5-4836eb31b18b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Converting VIF {"id": "36166625-6cf3-49f4-8a01-8a85d7fded91", "address": "fa:16:3e:08:c9:b4", "network": {"id": "22655d17-1e6d-4df4-bc29-88a8811e036b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1739013266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47fb12f1b9b84c128b9a9f5fcdb32c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36166625-6c", "ovs_interfaceid": "36166625-6cf3-49f4-8a01-8a85d7fded91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c9:b4,bridge_name='br-int',has_traffic_filtering=True,id=36166625-6cf3-49f4-8a01-8a85d7fded91,network=Network(22655d17-1e6d-4df4-bc29-88a8811e036b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36166625-6c') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG os_vif [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c9:b4,bridge_name='br-int',has_traffic_filtering=True,id=36166625-6cf3-49f4-8a01-8a85d7fded91,network=Network(22655d17-1e6d-4df4-bc29-88a8811e036b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36166625-6c') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36166625-6c, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:14 user nova-compute[74681]: INFO os_vif [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c9:b4,bridge_name='br-int',has_traffic_filtering=True,id=36166625-6cf3-49f4-8a01-8a85d7fded91,network=Network(22655d17-1e6d-4df4-bc29-88a8811e036b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36166625-6c')
Aug 16 06:21:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Deleting instance files /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b_del
Aug 16 06:21:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Deletion of /opt/stack/data/nova/instances/ab220126-7cda-4787-96b5-4836eb31b18b_del complete
Aug 16 06:21:14 user nova-compute[74681]: INFO nova.compute.manager [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 06:21:14 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:21:14 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:14 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Took 0.67 seconds to deallocate network for instance.
Aug 16 06:21:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-09e19320-4924-4cfb-b1ff-7f1893d3c6c2 req-fa58c559-88eb-4a3c-89b4-1fde0f43f673 service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received event network-vif-deleted-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:15 user nova-compute[74681]: INFO nova.compute.manager [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Unshelving
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.168s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'pci_requests' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'numa_topology' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:21:15 user nova-compute[74681]: INFO nova.compute.claims [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Claim successful on node user
Aug 16 06:21:15 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Deleted allocations for instance ab220126-7cda-4787-96b5-4836eb31b18b
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2654641e-5fa4-451a-a2b3-ae61e3bda489 tempest-VolumesActionsTest-1652006769 tempest-VolumesActionsTest-1652006769-project-member] Lock "ab220126-7cda-4787-96b5-4836eb31b18b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-544c9002-ba06-4689-b377-942894fdf098 req-bed1fd73-ea4d-4f1d-85fe-563ce3b30fc4 service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received event network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-544c9002-ba06-4689-b377-942894fdf098 req-bed1fd73-ea4d-4f1d-85fe-563ce3b30fc4 service nova] Acquiring lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-544c9002-ba06-4689-b377-942894fdf098 req-bed1fd73-ea4d-4f1d-85fe-563ce3b30fc4 service nova] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-544c9002-ba06-4689-b377-942894fdf098 req-bed1fd73-ea4d-4f1d-85fe-563ce3b30fc4 service nova] Lock "ab220126-7cda-4787-96b5-4836eb31b18b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-544c9002-ba06-4689-b377-942894fdf098 req-bed1fd73-ea4d-4f1d-85fe-563ce3b30fc4 service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] No waiting events found dispatching network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:15 user nova-compute[74681]: WARNING nova.compute.manager [req-544c9002-ba06-4689-b377-942894fdf098 req-bed1fd73-ea4d-4f1d-85fe-563ce3b30fc4 service nova] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Received unexpected event network-vif-plugged-36166625-6cf3-49f4-8a01-8a85d7fded91 for instance with vm_state deleted and task_state None.
Aug 16 06:21:16 user nova-compute[74681]: INFO nova.network.neutron [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updating port e207d8ba-006f-49c7-8166-227fa1009a28 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 06:21:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquired lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG nova.network.neutron [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ade5e44-db60-412a-8812-d1790fce34b3 req-d99efa6a-d499-49c1-ac07-70a07782dd23 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-changed-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-1ade5e44-db60-412a-8812-d1790fce34b3 req-d99efa6a-d499-49c1-ac07-70a07782dd23 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Refreshing instance network info cache due to event network-changed-e207d8ba-006f-49c7-8166-227fa1009a28. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ade5e44-db60-412a-8812-d1790fce34b3 req-d99efa6a-d499-49c1-ac07-70a07782dd23 service nova] Acquiring lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG nova.network.neutron [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updating instance_info_cache with network_info: [{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Releasing lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:21:17 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Creating image(s)
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'trusted_certs' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ade5e44-db60-412a-8812-d1790fce34b3 req-d99efa6a-d499-49c1-ac07-70a07782dd23 service nova] Acquired lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG nova.network.neutron [req-1ade5e44-db60-412a-8812-d1790fce34b3 req-d99efa6a-d499-49c1-ac07-70a07782dd23 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Refreshing network info cache for port e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "d9b4a47f0b2f4b2850b9282b33efa0667c81ac60" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "d9b4a47f0b2f4b2850b9282b33efa0667c81ac60" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:18 user nova-compute[74681]: DEBUG nova.virt.images [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] ea058060-87a0-430d-9b5b-a56d3ee76621 was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:21:18 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:21:18 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60.part /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG nova.network.neutron [req-1ade5e44-db60-412a-8812-d1790fce34b3 req-d99efa6a-d499-49c1-ac07-70a07782dd23 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updated VIF entry in instance network info cache for port e207d8ba-006f-49c7-8166-227fa1009a28. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG nova.network.neutron [req-1ade5e44-db60-412a-8812-d1790fce34b3 req-d99efa6a-d499-49c1-ac07-70a07782dd23 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updating instance_info_cache with network_info: [{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1ade5e44-db60-412a-8812-d1790fce34b3 req-d99efa6a-d499-49c1-ac07-70a07782dd23 service nova] Releasing lock "refresh_cache-20509fce-ff8d-4edc-85e9-c54375c274da" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60.part /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60.converted" returned: 0 in 0.765s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "d9b4a47f0b2f4b2850b9282b33efa0667c81ac60" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.244s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60 --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "d9b4a47f0b2f4b2850b9282b33efa0667c81ac60" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "d9b4a47f0b2f4b2850b9282b33efa0667c81ac60" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60 --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60,backing_fmt=raw /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60,backing_fmt=raw /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk 1073741824" returned: 0 in 0.052s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "d9b4a47f0b2f4b2850b9282b33efa0667c81ac60" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60 --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'migration_context' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:20 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Rebasing disk image.
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe -F raw /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe -F raw /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk" returned: 0 in 2.084s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Ensure instance console log exists: /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Start _get_guest_xml network_info=[{"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='79e6fdee89531dd605f90f91b1b658e5',container_format='bare',created_at=2023-08-16T06:19:22Z,direct_url=<?>,disk_format='qcow2',id=ea058060-87a0-430d-9b5b-a56d3ee76621,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1176396881-shelved',owner='f7ed7ef3df024e178e16f79008239e48',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-16T06:19:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:21:22 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:21:22 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='79e6fdee89531dd605f90f91b1b658e5',container_format='bare',created_at=2023-08-16T06:19:22Z,direct_url=<?>,disk_format='qcow2',id=ea058060-87a0-430d-9b5b-a56d3ee76621,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1176396881-shelved',owner='f7ed7ef3df024e178e16f79008239e48',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-16T06:19:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'vcpu_model' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1176396881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1176396881',id=22,image_ref='ea058060-87a0-430d-9b5b-a56d3ee76621',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1791209110',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-ktpwt4ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member',shelved_at='2023-08-16T06:19:26.256792',shelved_host='user',shelved_image_id='ea058060-87a0-430d-9b5b-a56d3ee76621'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=20509fce-ff8d-4edc-85e9-c54375c274da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'pci_devices' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:21:22 user nova-compute[74681]:   <uuid>20509fce-ff8d-4edc-85e9-c54375c274da</uuid>
Aug 16 06:21:22 user nova-compute[74681]:   <name>instance-00000016</name>
Aug 16 06:21:22 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:21:22 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:21:22 user nova-compute[74681]:   <metadata>
Aug 16 06:21:22 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:21:22 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:21:22 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1176396881</nova:name>
Aug 16 06:21:22 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:21:22</nova:creationTime>
Aug 16 06:21:22 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:21:22 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:21:22 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:21:22 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:21:22 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:21:22 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:21:22 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:21:22 user nova-compute[74681]:       <nova:owner>
Aug 16 06:21:22 user nova-compute[74681]:         <nova:user uuid="2e9ea2042eae46618172633ecf40bb62">tempest-AttachVolumeShelveTestJSON-1422435949-project-member</nova:user>
Aug 16 06:21:22 user nova-compute[74681]:         <nova:project uuid="f7ed7ef3df024e178e16f79008239e48">tempest-AttachVolumeShelveTestJSON-1422435949</nova:project>
Aug 16 06:21:22 user nova-compute[74681]:       </nova:owner>
Aug 16 06:21:22 user nova-compute[74681]:       <nova:root type="image" uuid="ea058060-87a0-430d-9b5b-a56d3ee76621"/>
Aug 16 06:21:22 user nova-compute[74681]:       <nova:ports>
Aug 16 06:21:22 user nova-compute[74681]:         <nova:port uuid="e207d8ba-006f-49c7-8166-227fa1009a28">
Aug 16 06:21:22 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:21:22 user nova-compute[74681]:         </nova:port>
Aug 16 06:21:22 user nova-compute[74681]:       </nova:ports>
Aug 16 06:21:22 user nova-compute[74681]:     </nova:instance>
Aug 16 06:21:22 user nova-compute[74681]:   </metadata>
Aug 16 06:21:22 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:21:22 user nova-compute[74681]:     <system>
Aug 16 06:21:22 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:21:22 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:21:22 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:21:22 user nova-compute[74681]:       <entry name="serial">20509fce-ff8d-4edc-85e9-c54375c274da</entry>
Aug 16 06:21:22 user nova-compute[74681]:       <entry name="uuid">20509fce-ff8d-4edc-85e9-c54375c274da</entry>
Aug 16 06:21:22 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:21:22 user nova-compute[74681]:     </system>
Aug 16 06:21:22 user nova-compute[74681]:   </sysinfo>
Aug 16 06:21:22 user nova-compute[74681]:   <os>
Aug 16 06:21:22 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:21:22 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:21:22 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:21:22 user nova-compute[74681]:   </os>
Aug 16 06:21:22 user nova-compute[74681]:   <features>
Aug 16 06:21:22 user nova-compute[74681]:     <acpi/>
Aug 16 06:21:22 user nova-compute[74681]:     <apic/>
Aug 16 06:21:22 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:21:22 user nova-compute[74681]:   </features>
Aug 16 06:21:22 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:21:22 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:21:22 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:21:22 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:21:22 user nova-compute[74681]:   </clock>
Aug 16 06:21:22 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:21:22 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:21:22 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:21:22 user nova-compute[74681]:   </cpu>
Aug 16 06:21:22 user nova-compute[74681]:   <devices>
Aug 16 06:21:22 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:21:22 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:21:22 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk"/>
Aug 16 06:21:22 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:21:22 user nova-compute[74681]:     </disk>
Aug 16 06:21:22 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:21:22 user nova-compute[74681]:       <mac address="fa:16:3e:e7:12:a2"/>
Aug 16 06:21:22 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:21:22 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:21:22 user nova-compute[74681]:       <target dev="tape207d8ba-00"/>
Aug 16 06:21:22 user nova-compute[74681]:     </interface>
Aug 16 06:21:22 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:21:22 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/console.log" append="off"/>
Aug 16 06:21:22 user nova-compute[74681]:     </serial>
Aug 16 06:21:22 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:21:22 user nova-compute[74681]:     <video>
Aug 16 06:21:22 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:21:22 user nova-compute[74681]:     </video>
Aug 16 06:21:22 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:21:22 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:21:22 user nova-compute[74681]:     </rng>
Aug 16 06:21:22 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:21:22 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:21:22 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:21:22 user nova-compute[74681]:     </memballoon>
Aug 16 06:21:22 user nova-compute[74681]:   </devices>
Aug 16 06:21:22 user nova-compute[74681]: </domain>
Aug 16 06:21:22 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1176396881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1176396881',id=22,image_ref='ea058060-87a0-430d-9b5b-a56d3ee76621',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1791209110',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-ktpwt4ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member',shelved_at='2023-08-16T06:19:26.256792',shelved_host='user',shelved_image_id='ea058060-87a0-430d-9b5b-a56d3ee76621'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=20509fce-ff8d-4edc-85e9-c54375c274da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG os_vif [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape207d8ba-00, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape207d8ba-00, col_values=(('external_ids', {'iface-id': 'e207d8ba-006f-49c7-8166-227fa1009a28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:12:a2', 'vm-uuid': '20509fce-ff8d-4edc-85e9-c54375c274da'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:22 user nova-compute[74681]: INFO os_vif [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00')
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:21:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] No VIF found with MAC fa:16:3e:e7:12:a2, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-0ca1bb96-8acb-41b1-8d5d-490f6d0d6e12 req-af600094-8291-4dbc-8fde-bb15035fee5b service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0ca1bb96-8acb-41b1-8d5d-490f6d0d6e12 req-af600094-8291-4dbc-8fde-bb15035fee5b service nova] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0ca1bb96-8acb-41b1-8d5d-490f6d0d6e12 req-af600094-8291-4dbc-8fde-bb15035fee5b service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0ca1bb96-8acb-41b1-8d5d-490f6d0d6e12 req-af600094-8291-4dbc-8fde-bb15035fee5b service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-0ca1bb96-8acb-41b1-8d5d-490f6d0d6e12 req-af600094-8291-4dbc-8fde-bb15035fee5b service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] No waiting events found dispatching network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:24 user nova-compute[74681]: WARNING nova.compute.manager [req-0ca1bb96-8acb-41b1-8d5d-490f6d0d6e12 req-af600094-8291-4dbc-8fde-bb15035fee5b service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received unexpected event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 06:21:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-7ae26bb2-99c2-469a-a27b-11ca6756428e req-8ca9d179-29c2-41d0-803f-6870aac3a6ec service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ae26bb2-99c2-469a-a27b-11ca6756428e req-8ca9d179-29c2-41d0-803f-6870aac3a6ec service nova] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ae26bb2-99c2-469a-a27b-11ca6756428e req-8ca9d179-29c2-41d0-803f-6870aac3a6ec service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ae26bb2-99c2-469a-a27b-11ca6756428e req-8ca9d179-29c2-41d0-803f-6870aac3a6ec service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-7ae26bb2-99c2-469a-a27b-11ca6756428e req-8ca9d179-29c2-41d0-803f-6870aac3a6ec service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] No waiting events found dispatching network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:26 user nova-compute[74681]: WARNING nova.compute.manager [req-7ae26bb2-99c2-469a-a27b-11ca6756428e req-8ca9d179-29c2-41d0-803f-6870aac3a6ec service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received unexpected event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166886.6389456, 20509fce-ff8d-4edc-85e9-c54375c274da => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] VM Resumed (Lifecycle Event)
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:21:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance spawned successfully.
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:21:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166886.6398146, 20509fce-ff8d-4edc-85e9-c54375c274da => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] VM Started (Lifecycle Event)
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:21:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:21:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9898f391-28c0-44a4-860b-4a4e3b418c09 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.828s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:28 user nova-compute[74681]: INFO nova.compute.manager [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Detaching volume a2f00b61-3c7f-4c25-8872-194ec197a42e
Aug 16 06:21:28 user nova-compute[74681]: INFO nova.virt.block_device [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Attempting to driver detach volume a2f00b61-3c7f-4c25-8872-194ec197a42e from mountpoint /dev/vdb
Aug 16 06:21:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Attempting to detach device vdb from instance ee235b33-937c-41f4-9052-fc7f9f200cbe from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:21:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:21:28 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:21:28 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:21:28 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:21:28 user nova-compute[74681]:   <serial>a2f00b61-3c7f-4c25-8872-194ec197a42e</serial>
Aug 16 06:21:28 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:21:28 user nova-compute[74681]: </disk>
Aug 16 06:21:28 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:21:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Successfully detached device vdb from instance ee235b33-937c-41f4-9052-fc7f9f200cbe from the persistent domain config.
Aug 16 06:21:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee235b33-937c-41f4-9052-fc7f9f200cbe from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:21:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:21:28 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:21:28 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:21:28 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:21:28 user nova-compute[74681]:   <serial>a2f00b61-3c7f-4c25-8872-194ec197a42e</serial>
Aug 16 06:21:28 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:21:28 user nova-compute[74681]: </disk>
Aug 16 06:21:28 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166874.1712043, ab220126-7cda-4787-96b5-4836eb31b18b => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:29 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] VM Stopped (Lifecycle Event)
Aug 16 06:21:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4e2ccb50-d063-4f3f-9f11-4922020aea56 None None] [instance: ab220126-7cda-4787-96b5-4836eb31b18b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166889.3547149, ee235b33-937c-41f4-9052-fc7f9f200cbe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:21:29 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Successfully detached device vdb from instance ee235b33-937c-41f4-9052-fc7f9f200cbe from the live domain config.
Aug 16 06:21:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLnEaqpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:21:29 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d106554-2edb-4afb-bea1-4b598819802e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809a8b7-27a2-4733-a4e5-76dc5bb99296]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:21:29 user nova-compute[74681]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:21:29 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e (non-flash)
Aug 16 06:21:29 user nova-compute[74681]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:21:29 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94a1dd5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2738a6ab-1dbc-403e-a976-e85ae70eeb30]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1429e3ea-ba4b-4c9c-bdb0-26031314ab9c]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e371074-99e4-471e-9f45-5454245c9922]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9082d74e-b08e-438e-acc7-23d26e1030bf]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaf24d0-bf41-4592-ae97-dea2fddcdb20]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fc449c-475f-4be7-b767-d912a9f33a6a]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e, portal: 172.16.0.220,3260]
Aug 16 06:21:29 user nova-compute[74681]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e, portal: 172.16.0.220,3260] successful.
Aug 16 06:21:29 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2f00b61-3c7f-4c25-8872-194ec197a42e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b8103f-041c-4a39-8942-4dc497ce933b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] <== disconnect_volume: return (280ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:21:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:21:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'flavor' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b8d75f4d-2406-4d62-8373-223697a69125 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.958s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:31 user nova-compute[74681]: INFO nova.compute.manager [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] instance snapshotting
Aug 16 06:21:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Beginning live snapshot process
Aug 16 06:21:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json -f qcow2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json -f qcow2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfqv4siqg/1689122d4abd492c8910c774d5470983.delta 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfqv4siqg/1689122d4abd492c8910c774d5470983.delta 1073741824" returned: 0 in 0.057s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:21:32 user nova-compute[74681]: INFO nova.compute.claims [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Claim successful on node user
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.network.neutron [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:21:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.policy [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '597807248b8f4c598235cf07b48d1de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1f3324efa34f56bab9b32dff44ac74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:21:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Creating image(s)
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "/opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "/opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "/opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk 1073741824" returned: 0 in 0.049s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:21:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Successfully created port: f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfqv4siqg/1689122d4abd492c8910c774d5470983.delta /opt/stack/data/nova/instances/snapshots/tmpfqv4siqg/1689122d4abd492c8910c774d5470983 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Cannot resize image /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lazy-loading 'migration_context' on Instance uuid 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Ensure instance console log exists: /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfqv4siqg/1689122d4abd492c8910c774d5470983.delta /opt/stack/data/nova/instances/snapshots/tmpfqv4siqg/1689122d4abd492c8910c774d5470983" returned: 0 in 0.455s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:33 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Snapshot extracted, beginning image upload
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Successfully updated port: f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "refresh_cache-29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquired lock "refresh_cache-29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-1671741d-3c5e-4a76-bf7c-dba8b7422358 req-41e4f316-9216-42af-923d-1434bb96ee39 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received event network-changed-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-1671741d-3c5e-4a76-bf7c-dba8b7422358 req-41e4f316-9216-42af-923d-1434bb96ee39 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Refreshing instance network info cache due to event network-changed-f0f9e0d1-3781-45b4-87f0-066666612593. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1671741d-3c5e-4a76-bf7c-dba8b7422358 req-41e4f316-9216-42af-923d-1434bb96ee39 service nova] Acquiring lock "refresh_cache-29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Updating instance_info_cache with network_info: [{"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Releasing lock "refresh_cache-29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Instance network_info: |[{"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1671741d-3c5e-4a76-bf7c-dba8b7422358 req-41e4f316-9216-42af-923d-1434bb96ee39 service nova] Acquired lock "refresh_cache-29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-1671741d-3c5e-4a76-bf7c-dba8b7422358 req-41e4f316-9216-42af-923d-1434bb96ee39 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Refreshing network info cache for port f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Start _get_guest_xml network_info=[{"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:21:34 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:21:34 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-157005552',display_name='tempest-VolumesActionsTest-instance-157005552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-157005552',id=31,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b1f3324efa34f56bab9b32dff44ac74',ramdisk_id='',reservation_id='r-uqtjtvrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-13411155',owner_user_name='tempest-VolumesActionsTest-13411155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:21:33Z,user_data=None,user_id='597807248b8f4c598235cf07b48d1de5',uuid=29fd28c8-c4a0-4c2e-9256-a59fcecb79f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converting VIF {"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:af:11,bridge_name='br-int',has_traffic_filtering=True,id=f0f9e0d1-3781-45b4-87f0-066666612593,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f9e0d1-37') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.objects.instance [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lazy-loading 'pci_devices' on Instance uuid 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:21:34 user nova-compute[74681]:   <uuid>29fd28c8-c4a0-4c2e-9256-a59fcecb79f6</uuid>
Aug 16 06:21:34 user nova-compute[74681]:   <name>instance-0000001f</name>
Aug 16 06:21:34 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:21:34 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:21:34 user nova-compute[74681]:   <metadata>
Aug 16 06:21:34 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:21:34 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:21:34 user nova-compute[74681]:       <nova:name>tempest-VolumesActionsTest-instance-157005552</nova:name>
Aug 16 06:21:34 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:21:34</nova:creationTime>
Aug 16 06:21:34 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:21:34 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:21:34 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:21:34 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:21:34 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:21:34 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:21:34 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:21:34 user nova-compute[74681]:       <nova:owner>
Aug 16 06:21:34 user nova-compute[74681]:         <nova:user uuid="597807248b8f4c598235cf07b48d1de5">tempest-VolumesActionsTest-13411155-project-member</nova:user>
Aug 16 06:21:34 user nova-compute[74681]:         <nova:project uuid="9b1f3324efa34f56bab9b32dff44ac74">tempest-VolumesActionsTest-13411155</nova:project>
Aug 16 06:21:34 user nova-compute[74681]:       </nova:owner>
Aug 16 06:21:34 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:21:34 user nova-compute[74681]:       <nova:ports>
Aug 16 06:21:34 user nova-compute[74681]:         <nova:port uuid="f0f9e0d1-3781-45b4-87f0-066666612593">
Aug 16 06:21:34 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 06:21:34 user nova-compute[74681]:         </nova:port>
Aug 16 06:21:34 user nova-compute[74681]:       </nova:ports>
Aug 16 06:21:34 user nova-compute[74681]:     </nova:instance>
Aug 16 06:21:34 user nova-compute[74681]:   </metadata>
Aug 16 06:21:34 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:21:34 user nova-compute[74681]:     <system>
Aug 16 06:21:34 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:21:34 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:21:34 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:21:34 user nova-compute[74681]:       <entry name="serial">29fd28c8-c4a0-4c2e-9256-a59fcecb79f6</entry>
Aug 16 06:21:34 user nova-compute[74681]:       <entry name="uuid">29fd28c8-c4a0-4c2e-9256-a59fcecb79f6</entry>
Aug 16 06:21:34 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:21:34 user nova-compute[74681]:     </system>
Aug 16 06:21:34 user nova-compute[74681]:   </sysinfo>
Aug 16 06:21:34 user nova-compute[74681]:   <os>
Aug 16 06:21:34 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:21:34 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:21:34 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:21:34 user nova-compute[74681]:   </os>
Aug 16 06:21:34 user nova-compute[74681]:   <features>
Aug 16 06:21:34 user nova-compute[74681]:     <acpi/>
Aug 16 06:21:34 user nova-compute[74681]:     <apic/>
Aug 16 06:21:34 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:21:34 user nova-compute[74681]:   </features>
Aug 16 06:21:34 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:21:34 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:21:34 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:21:34 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:21:34 user nova-compute[74681]:   </clock>
Aug 16 06:21:34 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:21:34 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:21:34 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:21:34 user nova-compute[74681]:   </cpu>
Aug 16 06:21:34 user nova-compute[74681]:   <devices>
Aug 16 06:21:34 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:21:34 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:21:34 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk"/>
Aug 16 06:21:34 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:21:34 user nova-compute[74681]:     </disk>
Aug 16 06:21:34 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:21:34 user nova-compute[74681]:       <mac address="fa:16:3e:a2:af:11"/>
Aug 16 06:21:34 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:21:34 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:21:34 user nova-compute[74681]:       <target dev="tapf0f9e0d1-37"/>
Aug 16 06:21:34 user nova-compute[74681]:     </interface>
Aug 16 06:21:34 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:21:34 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/console.log" append="off"/>
Aug 16 06:21:34 user nova-compute[74681]:     </serial>
Aug 16 06:21:34 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:21:34 user nova-compute[74681]:     <video>
Aug 16 06:21:34 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:21:34 user nova-compute[74681]:     </video>
Aug 16 06:21:34 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:21:34 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:21:34 user nova-compute[74681]:     </rng>
Aug 16 06:21:34 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:21:34 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:21:34 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:21:34 user nova-compute[74681]:     </memballoon>
Aug 16 06:21:34 user nova-compute[74681]:   </devices>
Aug 16 06:21:34 user nova-compute[74681]: </domain>
Aug 16 06:21:34 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-157005552',display_name='tempest-VolumesActionsTest-instance-157005552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-157005552',id=31,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b1f3324efa34f56bab9b32dff44ac74',ramdisk_id='',reservation_id='r-uqtjtvrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-13411155',owner_user_name='tempest-VolumesActionsTest-13411155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:21:33Z,user_data=None,user_id='597807248b8f4c598235cf07b48d1de5',uuid=29fd28c8-c4a0-4c2e-9256-a59fcecb79f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converting VIF {"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:af:11,bridge_name='br-int',has_traffic_filtering=True,id=f0f9e0d1-3781-45b4-87f0-066666612593,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f9e0d1-37') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG os_vif [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:af:11,bridge_name='br-int',has_traffic_filtering=True,id=f0f9e0d1-3781-45b4-87f0-066666612593,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f9e0d1-37') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0f9e0d1-37, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0f9e0d1-37, col_values=(('external_ids', {'iface-id': 'f0f9e0d1-3781-45b4-87f0-066666612593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:af:11', 'vm-uuid': '29fd28c8-c4a0-4c2e-9256-a59fcecb79f6'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:21:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:34 user nova-compute[74681]: INFO os_vif [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:af:11,bridge_name='br-int',has_traffic_filtering=True,id=f0f9e0d1-3781-45b4-87f0-066666612593,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f9e0d1-37')
Aug 16 06:21:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:21:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] No VIF found with MAC fa:16:3e:a2:af:11, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:21:35 user nova-compute[74681]: DEBUG nova.network.neutron [req-1671741d-3c5e-4a76-bf7c-dba8b7422358 req-41e4f316-9216-42af-923d-1434bb96ee39 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Updated VIF entry in instance network info cache for port f0f9e0d1-3781-45b4-87f0-066666612593. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:21:35 user nova-compute[74681]: DEBUG nova.network.neutron [req-1671741d-3c5e-4a76-bf7c-dba8b7422358 req-41e4f316-9216-42af-923d-1434bb96ee39 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Updating instance_info_cache with network_info: [{"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1671741d-3c5e-4a76-bf7c-dba8b7422358 req-41e4f316-9216-42af-923d-1434bb96ee39 service nova] Releasing lock "refresh_cache-29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:21:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Snapshot image upload complete
Aug 16 06:21:36 user nova-compute[74681]: INFO nova.compute.manager [None req-18cab961-901f-497f-add7-4c66ca9d4ed4 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Took 5.43 seconds to snapshot the instance on the hypervisor.
Aug 16 06:21:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f2dffd2-141a-40d5-a319-7004ad8700e2 req-5f124691-d171-4505-a24c-ea6beb257654 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received event network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f2dffd2-141a-40d5-a319-7004ad8700e2 req-5f124691-d171-4505-a24c-ea6beb257654 service nova] Acquiring lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f2dffd2-141a-40d5-a319-7004ad8700e2 req-5f124691-d171-4505-a24c-ea6beb257654 service nova] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f2dffd2-141a-40d5-a319-7004ad8700e2 req-5f124691-d171-4505-a24c-ea6beb257654 service nova] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f2dffd2-141a-40d5-a319-7004ad8700e2 req-5f124691-d171-4505-a24c-ea6beb257654 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] No waiting events found dispatching network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:36 user nova-compute[74681]: WARNING nova.compute.manager [req-4f2dffd2-141a-40d5-a319-7004ad8700e2 req-5f124691-d171-4505-a24c-ea6beb257654 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received unexpected event network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 for instance with vm_state building and task_state spawning.
Aug 16 06:21:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d04b6ae-7427-4525-b8c7-ead4a8a11d4b req-327cf837-cad2-468c-b4ee-fb04ee1f7406 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-changed-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d04b6ae-7427-4525-b8c7-ead4a8a11d4b req-327cf837-cad2-468c-b4ee-fb04ee1f7406 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Refreshing instance network info cache due to event network-changed-f2886dcc-dad5-4242-a05f-e88b51734354. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:21:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d04b6ae-7427-4525-b8c7-ead4a8a11d4b req-327cf837-cad2-468c-b4ee-fb04ee1f7406 service nova] Acquiring lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:21:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d04b6ae-7427-4525-b8c7-ead4a8a11d4b req-327cf837-cad2-468c-b4ee-fb04ee1f7406 service nova] Acquired lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:21:37 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d04b6ae-7427-4525-b8c7-ead4a8a11d4b req-327cf837-cad2-468c-b4ee-fb04ee1f7406 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Refreshing network info cache for port f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d04b6ae-7427-4525-b8c7-ead4a8a11d4b req-327cf837-cad2-468c-b4ee-fb04ee1f7406 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updated VIF entry in instance network info cache for port f2886dcc-dad5-4242-a05f-e88b51734354. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d04b6ae-7427-4525-b8c7-ead4a8a11d4b req-327cf837-cad2-468c-b4ee-fb04ee1f7406 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updating instance_info_cache with network_info: [{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d04b6ae-7427-4525-b8c7-ead4a8a11d4b req-327cf837-cad2-468c-b4ee-fb04ee1f7406 service nova] Releasing lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166898.716575, 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] VM Resumed (Lifecycle Event)
Aug 16 06:21:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Instance spawned successfully.
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:21:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166898.7167177, 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] VM Started (Lifecycle Event)
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:21:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:21:38 user nova-compute[74681]: INFO nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef7723da-6e8e-41d6-9a79-18bc37ae5dae req-5d9078a5-e741-4604-b312-93787bd83024 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received event network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef7723da-6e8e-41d6-9a79-18bc37ae5dae req-5d9078a5-e741-4604-b312-93787bd83024 service nova] Acquiring lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef7723da-6e8e-41d6-9a79-18bc37ae5dae req-5d9078a5-e741-4604-b312-93787bd83024 service nova] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef7723da-6e8e-41d6-9a79-18bc37ae5dae req-5d9078a5-e741-4604-b312-93787bd83024 service nova] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef7723da-6e8e-41d6-9a79-18bc37ae5dae req-5d9078a5-e741-4604-b312-93787bd83024 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] No waiting events found dispatching network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:38 user nova-compute[74681]: WARNING nova.compute.manager [req-ef7723da-6e8e-41d6-9a79-18bc37ae5dae req-5d9078a5-e741-4604-b312-93787bd83024 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received unexpected event network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 for instance with vm_state building and task_state spawning.
Aug 16 06:21:39 user nova-compute[74681]: INFO nova.compute.manager [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Took 6.88 seconds to build instance.
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-55174a8b-7cb3-4854-95bf-d60bc36d6bd5 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.035s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:21:39 user nova-compute[74681]: INFO nova.compute.claims [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Claim successful on node user
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:21:39 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:21:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:21:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG nova.policy [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2525cd466cfb4097b91557bc3f41313a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f8c98f4c524a85bfca647755fd7d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:21:40 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Creating image(s)
Aug 16 06:21:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "/opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "/opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "b5ad889db046948278e0c04d121c248506d16253" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b5ad889db046948278e0c04d121c248506d16253" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Successfully created port: 079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:21:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253.part --force-share --output=json" returned: 0 in 0.220s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:41 user nova-compute[74681]: DEBUG nova.virt.images [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] 57583fd5-fc30-40d4-824b-8694c4dc8da9 was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:21:41 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:21:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253.part /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253.part /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253.converted" returned: 0 in 0.321s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b5ad889db046948278e0c04d121c248506d16253" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.935s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253 --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "b5ad889db046948278e0c04d121c248506d16253" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b5ad889db046948278e0c04d121c248506d16253" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253 --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253,backing_fmt=raw /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253,backing_fmt=raw /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk 1073741824" returned: 0 in 0.105s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b5ad889db046948278e0c04d121c248506d16253" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Successfully updated port: 079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquired lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253 --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'migration_context' on Instance uuid b9979660-9f21-44ba-90c5-97d8314c1349 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-b5762c1d-f5bb-4252-9493-71b1e7afddc3 req-f696fd41-d69e-4624-ae3d-8fcb683040da service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-changed-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-b5762c1d-f5bb-4252-9493-71b1e7afddc3 req-f696fd41-d69e-4624-ae3d-8fcb683040da service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Refreshing instance network info cache due to event network-changed-079d5905-a27c-48be-bdfe-8290b155f68e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b5762c1d-f5bb-4252-9493-71b1e7afddc3 req-f696fd41-d69e-4624-ae3d-8fcb683040da service nova] Acquiring lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:21:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Ensure instance console log exists: /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:43 user nova-compute[74681]: INFO nova.compute.manager [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Attaching volume 4d096acd-4110-412e-93db-fa838b40e9ab to /dev/vdb
Aug 16 06:21:43 user nova-compute[74681]: DEBUG os_brick.utils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddc4681-fc2f-49ec-9119-532befd2d38f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e4fe5-be8e-40db-bffd-f031d46f8be4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updating instance_info_cache with network_info: [{"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c2e797-d062-449b-a2f9-2f7e2ab194b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c417c40a-d6b5-4df8-8e26-dd8ba513f8d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Releasing lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Instance network_info: |[{"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b5762c1d-f5bb-4252-9493-71b1e7afddc3 req-f696fd41-d69e-4624-ae3d-8fcb683040da service nova] Acquired lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-b5762c1d-f5bb-4252-9493-71b1e7afddc3 req-f696fd41-d69e-4624-ae3d-8fcb683040da service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Refreshing network info cache for port 079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Start _get_guest_xml network_info=[{"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e6e7ddea6582950b6d74779eb755cfb6',container_format='bare',created_at=2023-08-16T06:21:31Z,direct_url=<?>,disk_format='qcow2',id=57583fd5-fc30-40d4-824b-8694c4dc8da9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-453575656',owner='57f8c98f4c524a85bfca647755fd7d58',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T06:21:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '57583fd5-fc30-40d4-824b-8694c4dc8da9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:21:43 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9daff08-b62e-4699-92fc-fabfc55fa5df]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG os_brick.utils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updating existing volume attachment record: 20230635-c72c-4bab-9408-3e74034bf22b {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:21:43 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:21:43 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e6e7ddea6582950b6d74779eb755cfb6',container_format='bare',created_at=2023-08-16T06:21:31Z,direct_url=<?>,disk_format='qcow2',id=57583fd5-fc30-40d4-824b-8694c4dc8da9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-453575656',owner='57f8c98f4c524a85bfca647755fd7d58',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T06:21:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2011164207',display_name='tempest-TestStampPattern-server-2011164207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2011164207',id=32,image_ref='57583fd5-fc30-40d4-824b-8694c4dc8da9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzoECm225ySl+HyAlmG0sv7wKoEPsgT9yAcs4kwnRa7sd0iBSZuzh0d16UZNUGe8zI0GmoGVsQ+b0UCPKJRw9yS1GVP40Wte/bTkaY2V6aoCUjPKx00k6FD7VMDRaRk9A==',key_name='tempest-TestStampPattern-1999912138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57f8c98f4c524a85bfca647755fd7d58',ramdisk_id='',reservation_id='r-sgjwa9om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a95646fe-8d93-47c7-9590-dbbb54c479d2',image_min_disk='1',image_min_ram='0',image_owner_id='57f8c98f4c524a85bfca647755fd7d58',image_owner_project_name='tempest-TestStampPattern-699262125',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-699262125-project-member',image_user_id='2525cd466cfb4097b91557bc3f41313a',network_allocated='True',owner_project_name='tempest-TestStampPattern-699262125',owner_user_name='tempest-TestStampPattern-699262125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:21:40Z,user_data=None,user_id='2525cd466cfb4097b91557bc3f41313a',uuid=b9979660-9f21-44ba-90c5-97d8314c1349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converting VIF {"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=079d5905-a27c-48be-bdfe-8290b155f68e,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079d5905-a2') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'pci_devices' on Instance uuid b9979660-9f21-44ba-90c5-97d8314c1349 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:21:43 user nova-compute[74681]:   <uuid>b9979660-9f21-44ba-90c5-97d8314c1349</uuid>
Aug 16 06:21:43 user nova-compute[74681]:   <name>instance-00000020</name>
Aug 16 06:21:43 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:21:43 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:21:43 user nova-compute[74681]:   <metadata>
Aug 16 06:21:43 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:21:43 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:21:43 user nova-compute[74681]:       <nova:name>tempest-TestStampPattern-server-2011164207</nova:name>
Aug 16 06:21:43 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:21:43</nova:creationTime>
Aug 16 06:21:43 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:21:43 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:21:43 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:21:43 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:21:43 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:21:43 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:21:43 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:21:43 user nova-compute[74681]:       <nova:owner>
Aug 16 06:21:43 user nova-compute[74681]:         <nova:user uuid="2525cd466cfb4097b91557bc3f41313a">tempest-TestStampPattern-699262125-project-member</nova:user>
Aug 16 06:21:43 user nova-compute[74681]:         <nova:project uuid="57f8c98f4c524a85bfca647755fd7d58">tempest-TestStampPattern-699262125</nova:project>
Aug 16 06:21:43 user nova-compute[74681]:       </nova:owner>
Aug 16 06:21:43 user nova-compute[74681]:       <nova:root type="image" uuid="57583fd5-fc30-40d4-824b-8694c4dc8da9"/>
Aug 16 06:21:43 user nova-compute[74681]:       <nova:ports>
Aug 16 06:21:43 user nova-compute[74681]:         <nova:port uuid="079d5905-a27c-48be-bdfe-8290b155f68e">
Aug 16 06:21:43 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 06:21:43 user nova-compute[74681]:         </nova:port>
Aug 16 06:21:43 user nova-compute[74681]:       </nova:ports>
Aug 16 06:21:43 user nova-compute[74681]:     </nova:instance>
Aug 16 06:21:43 user nova-compute[74681]:   </metadata>
Aug 16 06:21:43 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:21:43 user nova-compute[74681]:     <system>
Aug 16 06:21:43 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:21:43 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:21:43 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:21:43 user nova-compute[74681]:       <entry name="serial">b9979660-9f21-44ba-90c5-97d8314c1349</entry>
Aug 16 06:21:43 user nova-compute[74681]:       <entry name="uuid">b9979660-9f21-44ba-90c5-97d8314c1349</entry>
Aug 16 06:21:43 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:21:43 user nova-compute[74681]:     </system>
Aug 16 06:21:43 user nova-compute[74681]:   </sysinfo>
Aug 16 06:21:43 user nova-compute[74681]:   <os>
Aug 16 06:21:43 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:21:43 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:21:43 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:21:43 user nova-compute[74681]:   </os>
Aug 16 06:21:43 user nova-compute[74681]:   <features>
Aug 16 06:21:43 user nova-compute[74681]:     <acpi/>
Aug 16 06:21:43 user nova-compute[74681]:     <apic/>
Aug 16 06:21:43 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:21:43 user nova-compute[74681]:   </features>
Aug 16 06:21:43 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:21:43 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:21:43 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:21:43 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:21:43 user nova-compute[74681]:   </clock>
Aug 16 06:21:43 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:21:43 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:21:43 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:21:43 user nova-compute[74681]:   </cpu>
Aug 16 06:21:43 user nova-compute[74681]:   <devices>
Aug 16 06:21:43 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:21:43 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:21:43 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk"/>
Aug 16 06:21:43 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:21:43 user nova-compute[74681]:     </disk>
Aug 16 06:21:43 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:21:43 user nova-compute[74681]:       <mac address="fa:16:3e:7b:e1:4f"/>
Aug 16 06:21:43 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:21:43 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:21:43 user nova-compute[74681]:       <target dev="tap079d5905-a2"/>
Aug 16 06:21:43 user nova-compute[74681]:     </interface>
Aug 16 06:21:43 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:21:43 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/console.log" append="off"/>
Aug 16 06:21:43 user nova-compute[74681]:     </serial>
Aug 16 06:21:43 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:21:43 user nova-compute[74681]:     <video>
Aug 16 06:21:43 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:21:43 user nova-compute[74681]:     </video>
Aug 16 06:21:43 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:21:43 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:21:43 user nova-compute[74681]:     </rng>
Aug 16 06:21:43 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:21:43 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:21:43 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:21:43 user nova-compute[74681]:     </memballoon>
Aug 16 06:21:43 user nova-compute[74681]:   </devices>
Aug 16 06:21:43 user nova-compute[74681]: </domain>
Aug 16 06:21:43 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2011164207',display_name='tempest-TestStampPattern-server-2011164207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2011164207',id=32,image_ref='57583fd5-fc30-40d4-824b-8694c4dc8da9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzoECm225ySl+HyAlmG0sv7wKoEPsgT9yAcs4kwnRa7sd0iBSZuzh0d16UZNUGe8zI0GmoGVsQ+b0UCPKJRw9yS1GVP40Wte/bTkaY2V6aoCUjPKx00k6FD7VMDRaRk9A==',key_name='tempest-TestStampPattern-1999912138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57f8c98f4c524a85bfca647755fd7d58',ramdisk_id='',reservation_id='r-sgjwa9om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a95646fe-8d93-47c7-9590-dbbb54c479d2',image_min_disk='1',image_min_ram='0',image_owner_id='57f8c98f4c524a85bfca647755fd7d58',image_owner_project_name='tempest-TestStampPattern-699262125',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-699262125-project-member',image_user_id='2525cd466cfb4097b91557bc3f41313a',network_allocated='True',owner_project_name='tempest-TestStampPattern-699262125',owner_user_name='tempest-TestStampPattern-699262125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:21:40Z,user_data=None,user_id='2525cd466cfb4097b91557bc3f41313a',uuid=b9979660-9f21-44ba-90c5-97d8314c1349,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converting VIF {"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=079d5905-a27c-48be-bdfe-8290b155f68e,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079d5905-a2') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG os_vif [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=079d5905-a27c-48be-bdfe-8290b155f68e,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079d5905-a2') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap079d5905-a2, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap079d5905-a2, col_values=(('external_ids', {'iface-id': '079d5905-a27c-48be-bdfe-8290b155f68e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:e1:4f', 'vm-uuid': 'b9979660-9f21-44ba-90c5-97d8314c1349'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:43 user nova-compute[74681]: INFO os_vif [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=079d5905-a27c-48be-bdfe-8290b155f68e,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079d5905-a2')
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No VIF found with MAC fa:16:3e:7b:e1:4f, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG nova.network.neutron [req-b5762c1d-f5bb-4252-9493-71b1e7afddc3 req-f696fd41-d69e-4624-ae3d-8fcb683040da service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updated VIF entry in instance network info cache for port 079d5905-a27c-48be-bdfe-8290b155f68e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG nova.network.neutron [req-b5762c1d-f5bb-4252-9493-71b1e7afddc3 req-f696fd41-d69e-4624-ae3d-8fcb683040da service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updating instance_info_cache with network_info: [{"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b5762c1d-f5bb-4252-9493-71b1e7afddc3 req-f696fd41-d69e-4624-ae3d-8fcb683040da service nova] Releasing lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-0cd82096-7eba-4783-9ebe-d69ade8c12f2 req-67b5acdf-84a0-4077-8eee-b2c91b7a8c82 service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0cd82096-7eba-4783-9ebe-d69ade8c12f2 req-67b5acdf-84a0-4077-8eee-b2c91b7a8c82 service nova] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0cd82096-7eba-4783-9ebe-d69ade8c12f2 req-67b5acdf-84a0-4077-8eee-b2c91b7a8c82 service nova] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0cd82096-7eba-4783-9ebe-d69ade8c12f2 req-67b5acdf-84a0-4077-8eee-b2c91b7a8c82 service nova] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-0cd82096-7eba-4783-9ebe-d69ade8c12f2 req-67b5acdf-84a0-4077-8eee-b2c91b7a8c82 service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] No waiting events found dispatching network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:45 user nova-compute[74681]: WARNING nova.compute.manager [req-0cd82096-7eba-4783-9ebe-d69ade8c12f2 req-67b5acdf-84a0-4077-8eee-b2c91b7a8c82 service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received unexpected event network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e for instance with vm_state building and task_state spawning.
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-6a6279f5-a413-4609-a752-ef413049c0a8 req-0ba0eb80-49e7-4386-8969-942c4e8343f2 service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6a6279f5-a413-4609-a752-ef413049c0a8 req-0ba0eb80-49e7-4386-8969-942c4e8343f2 service nova] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6a6279f5-a413-4609-a752-ef413049c0a8 req-0ba0eb80-49e7-4386-8969-942c4e8343f2 service nova] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6a6279f5-a413-4609-a752-ef413049c0a8 req-0ba0eb80-49e7-4386-8969-942c4e8343f2 service nova] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-6a6279f5-a413-4609-a752-ef413049c0a8 req-0ba0eb80-49e7-4386-8969-942c4e8343f2 service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] No waiting events found dispatching network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:47 user nova-compute[74681]: WARNING nova.compute.manager [req-6a6279f5-a413-4609-a752-ef413049c0a8 req-0ba0eb80-49e7-4386-8969-942c4e8343f2 service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received unexpected event network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e for instance with vm_state building and task_state spawning.
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166907.6539066, b9979660-9f21-44ba-90c5-97d8314c1349 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:47 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] VM Resumed (Lifecycle Event)
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:21:47 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Instance spawned successfully.
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:21:47 user nova-compute[74681]: INFO nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Took 7.43 seconds to spawn the instance on the hypervisor.
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:47 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166907.6564984, b9979660-9f21-44ba-90c5-97d8314c1349 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:21:47 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] VM Started (Lifecycle Event)
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:21:47 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:21:47 user nova-compute[74681]: INFO nova.compute.manager [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Took 8.45 seconds to build instance.
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1b34a03b-f1c7-4254-a7c8-90d24c3db3e3 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.593s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:21:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7077MB free_disk=25.232013702392578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance ee235b33-937c-41f4-9052-fc7f9f200cbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a95646fe-8d93-47c7-9590-dbbb54c479d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 22008167-5859-402a-88fb-13b14bd6f48f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 20509fce-ff8d-4edc-85e9-c54375c274da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b9979660-9f21-44ba-90c5-97d8314c1349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:21:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:21:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:21:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsTVWxkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:21:53 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:21:53 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:21:53 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf644fa9-4c29-4851-87d9-eaf92b989433]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:21:53 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db4d9e3-9a03-4e5f-b8e3-5edbd3e1ec0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab] added
Aug 16 06:21:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df5a587-149e-4241-a9bf-ff4dbe5a4330]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f3d5e0-011c-4a7c-8ea4-3e1ed4654fd1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsTVWxkZ {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsTVWxkZ" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216eba5-91ed-4c0e-a4fd-2deea94cf7d2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RsTVWxkZ'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6373021-f690-4318-9e34-d2e3d9375604]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a842eca9-d0ae-46d5-9b65-f09c4f784b90]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:21:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:21:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6222351-d956-4c58-ac47-c0e5a7415419]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260]
Aug 16 06:21:53 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260] successful.
Aug 16 06:21:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a0b48-5405-4384-b6d8-0b95a33394ec]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d07925b-5f99-49b5-a993-81c5ad1b26eb]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:21:53 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:21:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:21:53 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:21:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19d9b28-dfc5-411d-8a27-279c7967712b]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:21:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsTVWxkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:21:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:21:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23439386264373734', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:21:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439386264373734', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:21:54 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:21:54 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:21:54 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:21:54 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:21:54 user nova-compute[74681]:   <serial>4d096acd-4110-412e-93db-fa838b40e9ab</serial>
Aug 16 06:21:54 user nova-compute[74681]: </disk>
Aug 16 06:21:54 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:21:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:21:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:21:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No VIF found with MAC fa:16:3e:c6:73:6f, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:21:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fbc1a3b9-dca5-49af-ad3a-aab9379c71af tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.148s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8338009-e47d-4b96-81be-f2cb3f4c5794 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8338009-e47d-4b96-81be-f2cb3f4c5794 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8338009-e47d-4b96-81be-f2cb3f4c5794 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8338009-e47d-4b96-81be-f2cb3f4c5794 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74681) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f8338009-e47d-4b96-81be-f2cb3f4c5794 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG nova.compute.manager [req-5a73cc17-4f3e-4548-98f7-d18428c16810 req-3629507c-a1f4-4157-b586-2b3ac8451706 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5a73cc17-4f3e-4548-98f7-d18428c16810 req-3629507c-a1f4-4157-b586-2b3ac8451706 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5a73cc17-4f3e-4548-98f7-d18428c16810 req-3629507c-a1f4-4157-b586-2b3ac8451706 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5a73cc17-4f3e-4548-98f7-d18428c16810 req-3629507c-a1f4-4157-b586-2b3ac8451706 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:56 user nova-compute[74681]: DEBUG nova.compute.manager [req-5a73cc17-4f3e-4548-98f7-d18428c16810 req-3629507c-a1f4-4157-b586-2b3ac8451706 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:56 user nova-compute[74681]: WARNING nova.compute.manager [req-5a73cc17-4f3e-4548-98f7-d18428c16810 req-3629507c-a1f4-4157-b586-2b3ac8451706 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state active and task_state powering-off.
Aug 16 06:21:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance destroyed successfully.
Aug 16 06:21:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f8338009-e47d-4b96-81be-f2cb3f4c5794 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:21:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f8338009-e47d-4b96-81be-f2cb3f4c5794 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.858s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:21:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-5f224c41-2f3b-4ca9-b6e9-e96cdf522048 req-cfe5a1f5-81e7-48e9-b5ef-78f31621b965 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:21:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5f224c41-2f3b-4ca9-b6e9-e96cdf522048 req-cfe5a1f5-81e7-48e9-b5ef-78f31621b965 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:21:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5f224c41-2f3b-4ca9-b6e9-e96cdf522048 req-cfe5a1f5-81e7-48e9-b5ef-78f31621b965 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:21:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5f224c41-2f3b-4ca9-b6e9-e96cdf522048 req-cfe5a1f5-81e7-48e9-b5ef-78f31621b965 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:21:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-5f224c41-2f3b-4ca9-b6e9-e96cdf522048 req-cfe5a1f5-81e7-48e9-b5ef-78f31621b965 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:21:58 user nova-compute[74681]: WARNING nova.compute.manager [req-5f224c41-2f3b-4ca9-b6e9-e96cdf522048 req-cfe5a1f5-81e7-48e9-b5ef-78f31621b965 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state stopped and task_state None.
Aug 16 06:22:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:12 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166917.0999908, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:22:12 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Stopped (Lifecycle Event)
Aug 16 06:22:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-38d5c956-bdf4-4f10-927b-8e1550ff3858 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:22:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-38d5c956-bdf4-4f10-927b-8e1550ff3858 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:22:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:19 user nova-compute[74681]: INFO nova.compute.manager [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Terminating instance
Aug 16 06:22:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-7e7b13d3-fb3c-42e1-8732-caeb7bac29f7 req-accb0e05-b410-43e0-9b31-80dbf6c5e006 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received event network-vif-unplugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e7b13d3-fb3c-42e1-8732-caeb7bac29f7 req-accb0e05-b410-43e0-9b31-80dbf6c5e006 service nova] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e7b13d3-fb3c-42e1-8732-caeb7bac29f7 req-accb0e05-b410-43e0-9b31-80dbf6c5e006 service nova] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7e7b13d3-fb3c-42e1-8732-caeb7bac29f7 req-accb0e05-b410-43e0-9b31-80dbf6c5e006 service nova] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-7e7b13d3-fb3c-42e1-8732-caeb7bac29f7 req-accb0e05-b410-43e0-9b31-80dbf6c5e006 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] No waiting events found dispatching network-vif-unplugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:22:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-7e7b13d3-fb3c-42e1-8732-caeb7bac29f7 req-accb0e05-b410-43e0-9b31-80dbf6c5e006 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received event network-vif-unplugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:20 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Instance destroyed successfully.
Aug 16 06:22:20 user nova-compute[74681]: DEBUG nova.objects.instance [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lazy-loading 'resources' on Instance uuid ee235b33-937c-41f4-9052-fc7f9f200cbe {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-424669805',display_name='tempest-TestServerVolumeAttachmentScenario-server-424669805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-424669805',id=23,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDC0i6pQb8owEi3iKtlBr94k4/yCYEYByLjdQcYgvlhoJTktOJIxL1iyn3jgYvZPTRQ1dzHSHsyaxfHK46x1pn7Je+rMPF5R0G9kqagR39UqRV7JAL0p5qLvoOHveLa38A==',key_name='tempest-keypair-980930394',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23594847d83142ddb1c59f9673591bcd',ramdisk_id='',reservation_id='r-837ftmzv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-927507447',owner_user_name='tempest-TestServerVolumeAttachmentScenario-927507447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac2515512dca4405b1f3ba2ba988ee84',uuid=ee235b33-937c-41f4-9052-fc7f9f200cbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Converting VIF {"id": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "address": "fa:16:3e:cf:89:fd", "network": {"id": "5813a18d-712b-4498-b411-3ace04ad24f3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-669536391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23594847d83142ddb1c59f9673591bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1fe3499-88", "ovs_interfaceid": "a1fe3499-88a0-4b80-81a2-8d1a4da52b14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=a1fe3499-88a0-4b80-81a2-8d1a4da52b14,network=Network(5813a18d-712b-4498-b411-3ace04ad24f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fe3499-88') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG os_vif [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=a1fe3499-88a0-4b80-81a2-8d1a4da52b14,network=Network(5813a18d-712b-4498-b411-3ace04ad24f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fe3499-88') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1fe3499-88, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:20 user nova-compute[74681]: INFO os_vif [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:89:fd,bridge_name='br-int',has_traffic_filtering=True,id=a1fe3499-88a0-4b80-81a2-8d1a4da52b14,network=Network(5813a18d-712b-4498-b411-3ace04ad24f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1fe3499-88')
Aug 16 06:22:20 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Deleting instance files /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe_del
Aug 16 06:22:20 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Deletion of /opt/stack/data/nova/instances/ee235b33-937c-41f4-9052-fc7f9f200cbe_del complete
Aug 16 06:22:20 user nova-compute[74681]: INFO nova.compute.manager [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 06:22:20 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:22:20 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:22:21 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Took 0.82 seconds to deallocate network for instance.
Aug 16 06:22:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:22:21 user nova-compute[74681]: INFO nova.compute.manager [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] instance snapshotting
Aug 16 06:22:21 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Beginning live snapshot process
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json -f qcow2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:21 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Deleted allocations for instance ee235b33-937c-41f4-9052-fc7f9f200cbe
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json -f qcow2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-16482c87-30e1-4bf0-aab6-b0f1c3a18bb1 tempest-TestServerVolumeAttachmentScenario-927507447 tempest-TestServerVolumeAttachmentScenario-927507447-project-member] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-85e348a8-b3ea-4343-8afb-a9edb4440719 req-2ad56b30-ef20-4131-92cb-7f8c3508bb41 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received event network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-85e348a8-b3ea-4343-8afb-a9edb4440719 req-2ad56b30-ef20-4131-92cb-7f8c3508bb41 service nova] Acquiring lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-85e348a8-b3ea-4343-8afb-a9edb4440719 req-2ad56b30-ef20-4131-92cb-7f8c3508bb41 service nova] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-85e348a8-b3ea-4343-8afb-a9edb4440719 req-2ad56b30-ef20-4131-92cb-7f8c3508bb41 service nova] Lock "ee235b33-937c-41f4-9052-fc7f9f200cbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-85e348a8-b3ea-4343-8afb-a9edb4440719 req-2ad56b30-ef20-4131-92cb-7f8c3508bb41 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] No waiting events found dispatching network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:22:21 user nova-compute[74681]: WARNING nova.compute.manager [req-85e348a8-b3ea-4343-8afb-a9edb4440719 req-2ad56b30-ef20-4131-92cb-7f8c3508bb41 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received unexpected event network-vif-plugged-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 for instance with vm_state deleted and task_state None.
Aug 16 06:22:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-85e348a8-b3ea-4343-8afb-a9edb4440719 req-2ad56b30-ef20-4131-92cb-7f8c3508bb41 service nova] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Received event network-vif-deleted-a1fe3499-88a0-4b80-81a2-8d1a4da52b14 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxx_dqlz_/6e3e303d8aa94c799952d5da6016152c.delta 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxx_dqlz_/6e3e303d8aa94c799952d5da6016152c.delta 1073741824" returned: 0 in 0.092s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:22 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 06:22:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:22:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:22:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 06:22:23 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:22:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxx_dqlz_/6e3e303d8aa94c799952d5da6016152c.delta /opt/stack/data/nova/instances/snapshots/tmpxx_dqlz_/6e3e303d8aa94c799952d5da6016152c {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxx_dqlz_/6e3e303d8aa94c799952d5da6016152c.delta /opt/stack/data/nova/instances/snapshots/tmpxx_dqlz_/6e3e303d8aa94c799952d5da6016152c" returned: 0 in 0.534s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Snapshot extracted, beginning image upload
Aug 16 06:22:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-68f423de-578f-4164-85c0-0b0e19587124 req-6c18ba53-6d0e-4c1e-bfec-b47496487f41 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received event network-changed-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:22:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-68f423de-578f-4164-85c0-0b0e19587124 req-6c18ba53-6d0e-4c1e-bfec-b47496487f41 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Refreshing instance network info cache due to event network-changed-d997a09b-599b-4ba7-b9dd-86a654901271. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:22:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68f423de-578f-4164-85c0-0b0e19587124 req-6c18ba53-6d0e-4c1e-bfec-b47496487f41 service nova] Acquiring lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:22:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68f423de-578f-4164-85c0-0b0e19587124 req-6c18ba53-6d0e-4c1e-bfec-b47496487f41 service nova] Acquired lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:22:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-68f423de-578f-4164-85c0-0b0e19587124 req-6c18ba53-6d0e-4c1e-bfec-b47496487f41 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Refreshing network info cache for port d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:22:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-68f423de-578f-4164-85c0-0b0e19587124 req-6c18ba53-6d0e-4c1e-bfec-b47496487f41 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Updated VIF entry in instance network info cache for port d997a09b-599b-4ba7-b9dd-86a654901271. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:22:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-68f423de-578f-4164-85c0-0b0e19587124 req-6c18ba53-6d0e-4c1e-bfec-b47496487f41 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Updating instance_info_cache with network_info: [{"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:22:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68f423de-578f-4164-85c0-0b0e19587124 req-6c18ba53-6d0e-4c1e-bfec-b47496487f41 service nova] Releasing lock "refresh_cache-22008167-5859-402a-88fb-13b14bd6f48f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:22:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Snapshot image upload complete
Aug 16 06:22:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0e4c0f56-3ff4-48dc-b860-55b55f8a6140 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Took 5.21 seconds to snapshot the instance on the hypervisor.
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 22008167-5859-402a-88fb-13b14bd6f48f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:29 user nova-compute[74681]: INFO nova.compute.manager [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Attaching volume 37e1fe6f-40df-4264-958e-441f0d2c339a to /dev/vdb
Aug 16 06:22:29 user nova-compute[74681]: DEBUG os_brick.utils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14c0e08-e413-468c-be25-a3f34b9fe99d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6352bd4d-1c9a-4a01-9cfe-cd1031ef3e58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74116a6-a06b-4f93-9abc-e006c1c99b7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9934e5c9-984a-41f2-ba17-efa0a27ce6bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:22:29 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:22:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[20696359-5948-44f8-a19d-76018e221e57]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG os_brick.utils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:22:29 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Updating existing volume attachment record: 0c0b962f-4d49-4014-8958-204d177cdd42 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:22:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:34 user nova-compute[74681]: INFO nova.compute.manager [None req-b573e883-790a-4107-9a04-0a2a444b8470 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Unrescuing
Aug 16 06:22:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b573e883-790a-4107-9a04-0a2a444b8470 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:22:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b573e883-790a-4107-9a04-0a2a444b8470 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquired lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:22:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b573e883-790a-4107-9a04-0a2a444b8470 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b573e883-790a-4107-9a04-0a2a444b8470 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updating instance_info_cache with network_info: [{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b573e883-790a-4107-9a04-0a2a444b8470 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Releasing lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b573e883-790a-4107-9a04-0a2a444b8470 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'flavor' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166940.2500095, ee235b33-937c-41f4-9052-fc7f9f200cbe => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:22:35 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] VM Stopped (Lifecycle Event)
Aug 16 06:22:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8074908e-026d-4c0d-91c3-e85231705176 None None] [instance: ee235b33-937c-41f4-9052-fc7f9f200cbe] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-14e17703-ca3c-41ff-83bc-a34b4bff77a6 req-ad6e3914-aaf0-4c76-8ad9-fd8c73243d23 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-14e17703-ca3c-41ff-83bc-a34b4bff77a6 req-ad6e3914-aaf0-4c76-8ad9-fd8c73243d23 service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-14e17703-ca3c-41ff-83bc-a34b4bff77a6 req-ad6e3914-aaf0-4c76-8ad9-fd8c73243d23 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-14e17703-ca3c-41ff-83bc-a34b4bff77a6 req-ad6e3914-aaf0-4c76-8ad9-fd8c73243d23 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-14e17703-ca3c-41ff-83bc-a34b4bff77a6 req-ad6e3914-aaf0-4c76-8ad9-fd8c73243d23 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:22:35 user nova-compute[74681]: WARNING nova.compute.manager [req-14e17703-ca3c-41ff-83bc-a34b4bff77a6 req-ad6e3914-aaf0-4c76-8ad9-fd8c73243d23 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:22:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance destroyed successfully.
Aug 16 06:22:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:22:37 user nova-compute[74681]: WARNING nova.compute.manager [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:22:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:22:37 user nova-compute[74681]: WARNING nova.compute.manager [req-4b5e270b-3f3a-4dcc-94c4-a871d3283b88 req-58c1ffe9-3b6d-474e-9aa0-8cd873d3fd6b service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:22:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKfxFjmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:22:38 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:22:38 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:22:38 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc15736-8a04-4e48-b921-4a6ce9a344c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:22:38 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[769cf764-2521-4d7a-b659-dd6e5acebe5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a] added
Aug 16 06:22:38 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db1f0e1-c429-4f5b-8a65-0c62e2ae09b4]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e832b6bc-b3c9-4180-adb4-f54876218b0b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aKfxFjmh {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aKfxFjmh" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bbc90d-6ab0-43c1-9f3d-9de9848421db]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aKfxFjmh'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e06af9b-22a8-4897-999c-55d85345d3d8]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[605429ad-2f71-4ab5-8147-7914c1c4bd68]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:22:38 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:22:38 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:22:38 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:22:38 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3169645f-260b-4c9b-a81c-d5ec957d894b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a, portal: 172.16.0.220,3260]
Aug 16 06:22:38 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a, portal: 172.16.0.220,3260] successful.
Aug 16 06:22:38 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d63d93c-676f-4b67-89db-56c4da505b90]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0844d75-fb5a-4e0e-90bb-d615d6544df5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:22:38 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:22:38 user nova-compute[74681]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a (non-flash)
Aug 16 06:22:38 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:22:38 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:22:38 user nova-compute[74681]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a (non-flash)
Aug 16 06:22:38 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d010e766-f7e5-4ccb-a024-8c218c87ce09]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:38 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for 6485c0f0-71dd-48f3-b2fe-449e1770cda7 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166959.485376, 6485c0f0-71dd-48f3-b2fe-449e1770cda7 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:22:39 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] VM Resumed (Lifecycle Event)
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b573e883-790a-4107-9a04-0a2a444b8470 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:22:39 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166959.4890397, 6485c0f0-71dd-48f3-b2fe-449e1770cda7 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:22:39 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] VM Started (Lifecycle Event)
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-e81cc1f5-01f2-405c-a5a3-e449a09b6712 req-dac4cfe8-58cc-4155-a589-dd8c5d3f46b5 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e81cc1f5-01f2-405c-a5a3-e449a09b6712 req-dac4cfe8-58cc-4155-a589-dd8c5d3f46b5 service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e81cc1f5-01f2-405c-a5a3-e449a09b6712 req-dac4cfe8-58cc-4155-a589-dd8c5d3f46b5 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e81cc1f5-01f2-405c-a5a3-e449a09b6712 req-dac4cfe8-58cc-4155-a589-dd8c5d3f46b5 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-e81cc1f5-01f2-405c-a5a3-e449a09b6712 req-dac4cfe8-58cc-4155-a589-dd8c5d3f46b5 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:22:39 user nova-compute[74681]: WARNING nova.compute.manager [req-e81cc1f5-01f2-405c-a5a3-e449a09b6712 req-dac4cfe8-58cc-4155-a589-dd8c5d3f46b5 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state active and task_state None.
Aug 16 06:22:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKfxFjmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23636356331353736', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636356331353736', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 22008167-5859-402a-88fb-13b14bd6f48f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:22:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:22:39 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:22:39 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:22:39 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:22:39 user nova-compute[74681]:   <serial>37e1fe6f-40df-4264-958e-441f0d2c339a</serial>
Aug 16 06:22:39 user nova-compute[74681]: </disk>
Aug 16 06:22:39 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:22:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:22:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:22:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] No VIF found with MAC fa:16:3e:07:ea:da, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:22:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2303783b-d106-4e89-9264-d2d1e772cd5b tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.159s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:41 user nova-compute[74681]: INFO nova.compute.manager [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Detaching volume 37e1fe6f-40df-4264-958e-441f0d2c339a
Aug 16 06:22:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updating instance_info_cache with network_info: [{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:22:41 user nova-compute[74681]: INFO nova.virt.block_device [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Attempting to driver detach volume 37e1fe6f-40df-4264-958e-441f0d2c339a from mountpoint /dev/vdb
Aug 16 06:22:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Attempting to detach device vdb from instance 22008167-5859-402a-88fb-13b14bd6f48f from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:22:41 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:22:41 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:22:41 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:22:41 user nova-compute[74681]:   <serial>37e1fe6f-40df-4264-958e-441f0d2c339a</serial>
Aug 16 06:22:41 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:22:41 user nova-compute[74681]: </disk>
Aug 16 06:22:41 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:22:41 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully detached device vdb from instance 22008167-5859-402a-88fb-13b14bd6f48f from the persistent domain config.
Aug 16 06:22:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22008167-5859-402a-88fb-13b14bd6f48f from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:22:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:22:41 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:22:41 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:22:41 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:22:41 user nova-compute[74681]:   <serial>37e1fe6f-40df-4264-958e-441f0d2c339a</serial>
Aug 16 06:22:41 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:22:41 user nova-compute[74681]: </disk>
Aug 16 06:22:41 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692166962.1563785, 22008167-5859-402a-88fb-13b14bd6f48f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22008167-5859-402a-88fb-13b14bd6f48f {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:22:42 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully detached device vdb from instance 22008167-5859-402a-88fb-13b14bd6f48f from the live domain config.
Aug 16 06:22:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aKfxFjmh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:22:42 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eefbc6d-deae-4cfd-8c5e-87b0ad97f873]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34e4f2f-e73b-4f4c-8b7f-2e8949bf7082]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:22:42 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:22:42 user nova-compute[74681]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a (non-flash)
Aug 16 06:22:42 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:22:42 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:22:42 user nova-compute[74681]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a (non-flash)
Aug 16 06:22:42 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948461a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e4bced-bee9-4e80-a62e-8f8e2578f9ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc75283-2996-485b-af21-c4cbde1e8042]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12ac94b-90a2-4bc1-955c-51e62745ac57]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e01591-7f24-43da-9492-1ed10dee5923]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8194bb-493c-4002-b56d-caa0dc6365e2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b317f-2314-4add-bd74-fafd5290ca61]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a, portal: 172.16.0.220,3260]
Aug 16 06:22:42 user nova-compute[74681]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a, portal: 172.16.0.220,3260] successful.
Aug 16 06:22:42 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37e1fe6f-40df-4264-958e-441f0d2c339a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a967fc-0ed0-4b9b-af8e-b47f770e6dbf]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] <== disconnect_volume: return (283ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:22:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:22:43 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:43 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'flavor' on Instance uuid 22008167-5859-402a-88fb-13b14bd6f48f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:22:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b7b9be4a-3c77-4057-9ed3-a94d52702d38 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.745s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:22:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:22:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:22:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7163MB free_disk=25.17056655883789GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a95646fe-8d93-47c7-9590-dbbb54c479d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 22008167-5859-402a-88fb-13b14bd6f48f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 20509fce-ff8d-4edc-85e9-c54375c274da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b9979660-9f21-44ba-90c5-97d8314c1349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:22:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:22:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:22:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:22:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:22:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:22:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:05 user nova-compute[74681]: INFO nova.compute.manager [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Terminating instance
Aug 16 06:23:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-7262c6b0-f30a-492f-a1f7-6d6e17faff97 req-12e1cf3b-4085-42b2-b6f0-cdaddbda94e9 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-unplugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7262c6b0-f30a-492f-a1f7-6d6e17faff97 req-12e1cf3b-4085-42b2-b6f0-cdaddbda94e9 service nova] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7262c6b0-f30a-492f-a1f7-6d6e17faff97 req-12e1cf3b-4085-42b2-b6f0-cdaddbda94e9 service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7262c6b0-f30a-492f-a1f7-6d6e17faff97 req-12e1cf3b-4085-42b2-b6f0-cdaddbda94e9 service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-7262c6b0-f30a-492f-a1f7-6d6e17faff97 req-12e1cf3b-4085-42b2-b6f0-cdaddbda94e9 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] No waiting events found dispatching network-vif-unplugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-7262c6b0-f30a-492f-a1f7-6d6e17faff97 req-12e1cf3b-4085-42b2-b6f0-cdaddbda94e9 service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-unplugged-e207d8ba-006f-49c7-8166-227fa1009a28 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:23:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Instance destroyed successfully.
Aug 16 06:23:06 user nova-compute[74681]: DEBUG nova.objects.instance [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lazy-loading 'resources' on Instance uuid 20509fce-ff8d-4edc-85e9-c54375c274da {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1176396881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1176396881',id=22,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCpwDAIgdlWm3QRLdDXekBMeHU+NMDigNAkU342zi7/hIVEgAx/QvGX2TSqaNifbIdghzAwqEWT4JEoxkV1nm8yRPJ91JXtgmrMlWeL6vkPb0ppFUZrFgbC3YHx84+sZQ==',key_name='tempest-keypair-1791209110',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:21:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ed7ef3df024e178e16f79008239e48',ramdisk_id='',reservation_id='r-ktpwt4ry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1422435949',owner_user_name='tempest-AttachVolumeShelveTestJSON-1422435949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:21:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e9ea2042eae46618172633ecf40bb62',uuid=20509fce-ff8d-4edc-85e9-c54375c274da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converting VIF {"id": "e207d8ba-006f-49c7-8166-227fa1009a28", "address": "fa:16:3e:e7:12:a2", "network": {"id": "6c142396-3851-4cfa-8dd7-7d773a8a216e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1971659773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7ed7ef3df024e178e16f79008239e48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape207d8ba-00", "ovs_interfaceid": "e207d8ba-006f-49c7-8166-227fa1009a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG os_vif [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape207d8ba-00, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:06 user nova-compute[74681]: INFO os_vif [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:12:a2,bridge_name='br-int',has_traffic_filtering=True,id=e207d8ba-006f-49c7-8166-227fa1009a28,network=Network(6c142396-3851-4cfa-8dd7-7d773a8a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape207d8ba-00')
Aug 16 06:23:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Deleting instance files /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da_del
Aug 16 06:23:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Deletion of /opt/stack/data/nova/instances/20509fce-ff8d-4edc-85e9-c54375c274da_del complete
Aug 16 06:23:06 user nova-compute[74681]: INFO nova.compute.manager [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 06:23:06 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:23:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:07 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Took 0.99 seconds to deallocate network for instance.
Aug 16 06:23:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:07 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Deleted allocations for instance 20509fce-ff8d-4edc-85e9-c54375c274da
Aug 16 06:23:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-355e2be2-d228-440b-a2d0-3da14ab0d956 req-6bbddc2c-bdd1-48bb-ae3b-f329efe8622f service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-355e2be2-d228-440b-a2d0-3da14ab0d956 req-6bbddc2c-bdd1-48bb-ae3b-f329efe8622f service nova] Acquiring lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-355e2be2-d228-440b-a2d0-3da14ab0d956 req-6bbddc2c-bdd1-48bb-ae3b-f329efe8622f service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-355e2be2-d228-440b-a2d0-3da14ab0d956 req-6bbddc2c-bdd1-48bb-ae3b-f329efe8622f service nova] Lock "20509fce-ff8d-4edc-85e9-c54375c274da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-355e2be2-d228-440b-a2d0-3da14ab0d956 req-6bbddc2c-bdd1-48bb-ae3b-f329efe8622f service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] No waiting events found dispatching network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:07 user nova-compute[74681]: WARNING nova.compute.manager [req-355e2be2-d228-440b-a2d0-3da14ab0d956 req-6bbddc2c-bdd1-48bb-ae3b-f329efe8622f service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received unexpected event network-vif-plugged-e207d8ba-006f-49c7-8166-227fa1009a28 for instance with vm_state deleted and task_state None.
Aug 16 06:23:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-355e2be2-d228-440b-a2d0-3da14ab0d956 req-6bbddc2c-bdd1-48bb-ae3b-f329efe8622f service nova] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Received event network-vif-deleted-e207d8ba-006f-49c7-8166-227fa1009a28 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-27a098a8-9415-4a9d-a861-bed02e784949 tempest-AttachVolumeShelveTestJSON-1422435949 tempest-AttachVolumeShelveTestJSON-1422435949-project-member] Lock "20509fce-ff8d-4edc-85e9-c54375c274da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.474s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "56e65553-f0ca-4d54-982b-0c40973fdf6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:23:12 user nova-compute[74681]: INFO nova.compute.claims [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Claim successful on node user
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:23:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:23:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Creating image(s)
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "/opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "/opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "/opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG nova.policy [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a48918c7f8f465695adf91994fee4c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '263626a2961b45609a4307552afc9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.214s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk 1073741824" returned: 0 in 0.064s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Cannot resize image /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lazy-loading 'migration_context' on Instance uuid 56e65553-f0ca-4d54-982b-0c40973fdf6b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Ensure instance console log exists: /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:14 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Successfully created port: 3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:23:14 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Successfully updated port: 3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:23:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "refresh_cache-56e65553-f0ca-4d54-982b-0c40973fdf6b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:23:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquired lock "refresh_cache-56e65553-f0ca-4d54-982b-0c40973fdf6b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:23:14 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:23:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-3acce3c6-e043-4745-81ce-5b34d7af46e7 req-52cc21f4-33e7-49a3-9318-df23ce0e1e35 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received event network-changed-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-3acce3c6-e043-4745-81ce-5b34d7af46e7 req-52cc21f4-33e7-49a3-9318-df23ce0e1e35 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Refreshing instance network info cache due to event network-changed-3382af8e-8be9-44cc-8746-42d13e140363. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:23:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3acce3c6-e043-4745-81ce-5b34d7af46e7 req-52cc21f4-33e7-49a3-9318-df23ce0e1e35 service nova] Acquiring lock "refresh_cache-56e65553-f0ca-4d54-982b-0c40973fdf6b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Updating instance_info_cache with network_info: [{"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Releasing lock "refresh_cache-56e65553-f0ca-4d54-982b-0c40973fdf6b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Instance network_info: |[{"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3acce3c6-e043-4745-81ce-5b34d7af46e7 req-52cc21f4-33e7-49a3-9318-df23ce0e1e35 service nova] Acquired lock "refresh_cache-56e65553-f0ca-4d54-982b-0c40973fdf6b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.neutron [req-3acce3c6-e043-4745-81ce-5b34d7af46e7 req-52cc21f4-33e7-49a3-9318-df23ce0e1e35 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Refreshing network info cache for port 3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Start _get_guest_xml network_info=[{"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:23:15 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:23:15 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1300516611',display_name='tempest-VolumesNegativeTest-instance-1300516611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1300516611',id=33,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='263626a2961b45609a4307552afc9ef8',ramdisk_id='',reservation_id='r-4znkv0d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-92364969',owner_user_name='tempest-VolumesNegativeTest-92364969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:23:13Z,user_data=None,user_id='4a48918c7f8f465695adf91994fee4c2',uuid=56e65553-f0ca-4d54-982b-0c40973fdf6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Converting VIF {"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:0e:5c,bridge_name='br-int',has_traffic_filtering=True,id=3382af8e-8be9-44cc-8746-42d13e140363,network=Network(2c5d001c-93c4-4b48-af22-3bcc222b4de6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3382af8e-8b') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lazy-loading 'pci_devices' on Instance uuid 56e65553-f0ca-4d54-982b-0c40973fdf6b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:23:15 user nova-compute[74681]:   <uuid>56e65553-f0ca-4d54-982b-0c40973fdf6b</uuid>
Aug 16 06:23:15 user nova-compute[74681]:   <name>instance-00000021</name>
Aug 16 06:23:15 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:23:15 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:23:15 user nova-compute[74681]:   <metadata>
Aug 16 06:23:15 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:23:15 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:23:15 user nova-compute[74681]:       <nova:name>tempest-VolumesNegativeTest-instance-1300516611</nova:name>
Aug 16 06:23:15 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:23:15</nova:creationTime>
Aug 16 06:23:15 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:23:15 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:23:15 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:23:15 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:23:15 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:23:15 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:23:15 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:23:15 user nova-compute[74681]:       <nova:owner>
Aug 16 06:23:15 user nova-compute[74681]:         <nova:user uuid="4a48918c7f8f465695adf91994fee4c2">tempest-VolumesNegativeTest-92364969-project-member</nova:user>
Aug 16 06:23:15 user nova-compute[74681]:         <nova:project uuid="263626a2961b45609a4307552afc9ef8">tempest-VolumesNegativeTest-92364969</nova:project>
Aug 16 06:23:15 user nova-compute[74681]:       </nova:owner>
Aug 16 06:23:15 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:23:15 user nova-compute[74681]:       <nova:ports>
Aug 16 06:23:15 user nova-compute[74681]:         <nova:port uuid="3382af8e-8be9-44cc-8746-42d13e140363">
Aug 16 06:23:15 user nova-compute[74681]:           <nova:ip type="fixed" address="192.168.233.132" ipVersion="4"/>
Aug 16 06:23:15 user nova-compute[74681]:         </nova:port>
Aug 16 06:23:15 user nova-compute[74681]:       </nova:ports>
Aug 16 06:23:15 user nova-compute[74681]:     </nova:instance>
Aug 16 06:23:15 user nova-compute[74681]:   </metadata>
Aug 16 06:23:15 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:23:15 user nova-compute[74681]:     <system>
Aug 16 06:23:15 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:23:15 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:23:15 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:23:15 user nova-compute[74681]:       <entry name="serial">56e65553-f0ca-4d54-982b-0c40973fdf6b</entry>
Aug 16 06:23:15 user nova-compute[74681]:       <entry name="uuid">56e65553-f0ca-4d54-982b-0c40973fdf6b</entry>
Aug 16 06:23:15 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:23:15 user nova-compute[74681]:     </system>
Aug 16 06:23:15 user nova-compute[74681]:   </sysinfo>
Aug 16 06:23:15 user nova-compute[74681]:   <os>
Aug 16 06:23:15 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:23:15 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:23:15 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:23:15 user nova-compute[74681]:   </os>
Aug 16 06:23:15 user nova-compute[74681]:   <features>
Aug 16 06:23:15 user nova-compute[74681]:     <acpi/>
Aug 16 06:23:15 user nova-compute[74681]:     <apic/>
Aug 16 06:23:15 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:23:15 user nova-compute[74681]:   </features>
Aug 16 06:23:15 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:23:15 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:23:15 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:23:15 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:23:15 user nova-compute[74681]:   </clock>
Aug 16 06:23:15 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:23:15 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:23:15 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:23:15 user nova-compute[74681]:   </cpu>
Aug 16 06:23:15 user nova-compute[74681]:   <devices>
Aug 16 06:23:15 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:23:15 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:23:15 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk"/>
Aug 16 06:23:15 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:23:15 user nova-compute[74681]:     </disk>
Aug 16 06:23:15 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:23:15 user nova-compute[74681]:       <mac address="fa:16:3e:d8:0e:5c"/>
Aug 16 06:23:15 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:23:15 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:23:15 user nova-compute[74681]:       <target dev="tap3382af8e-8b"/>
Aug 16 06:23:15 user nova-compute[74681]:     </interface>
Aug 16 06:23:15 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:23:15 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/console.log" append="off"/>
Aug 16 06:23:15 user nova-compute[74681]:     </serial>
Aug 16 06:23:15 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:23:15 user nova-compute[74681]:     <video>
Aug 16 06:23:15 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:23:15 user nova-compute[74681]:     </video>
Aug 16 06:23:15 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:23:15 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:23:15 user nova-compute[74681]:     </rng>
Aug 16 06:23:15 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:23:15 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:23:15 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:23:15 user nova-compute[74681]:     </memballoon>
Aug 16 06:23:15 user nova-compute[74681]:   </devices>
Aug 16 06:23:15 user nova-compute[74681]: </domain>
Aug 16 06:23:15 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1300516611',display_name='tempest-VolumesNegativeTest-instance-1300516611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1300516611',id=33,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='263626a2961b45609a4307552afc9ef8',ramdisk_id='',reservation_id='r-4znkv0d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-92364969',owner_user_name='tempest-VolumesNegativeTest-92364969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:23:13Z,user_data=None,user_id='4a48918c7f8f465695adf91994fee4c2',uuid=56e65553-f0ca-4d54-982b-0c40973fdf6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Converting VIF {"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:0e:5c,bridge_name='br-int',has_traffic_filtering=True,id=3382af8e-8be9-44cc-8746-42d13e140363,network=Network(2c5d001c-93c4-4b48-af22-3bcc222b4de6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3382af8e-8b') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG os_vif [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:0e:5c,bridge_name='br-int',has_traffic_filtering=True,id=3382af8e-8be9-44cc-8746-42d13e140363,network=Network(2c5d001c-93c4-4b48-af22-3bcc222b4de6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3382af8e-8b') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3382af8e-8b, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3382af8e-8b, col_values=(('external_ids', {'iface-id': '3382af8e-8be9-44cc-8746-42d13e140363', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:0e:5c', 'vm-uuid': '56e65553-f0ca-4d54-982b-0c40973fdf6b'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:15 user nova-compute[74681]: INFO os_vif [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:0e:5c,bridge_name='br-int',has_traffic_filtering=True,id=3382af8e-8be9-44cc-8746-42d13e140363,network=Network(2c5d001c-93c4-4b48-af22-3bcc222b4de6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3382af8e-8b')
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] No VIF found with MAC fa:16:3e:d8:0e:5c, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.neutron [req-3acce3c6-e043-4745-81ce-5b34d7af46e7 req-52cc21f4-33e7-49a3-9318-df23ce0e1e35 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Updated VIF entry in instance network info cache for port 3382af8e-8be9-44cc-8746-42d13e140363. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG nova.network.neutron [req-3acce3c6-e043-4745-81ce-5b34d7af46e7 req-52cc21f4-33e7-49a3-9318-df23ce0e1e35 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Updating instance_info_cache with network_info: [{"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3acce3c6-e043-4745-81ce-5b34d7af46e7 req-52cc21f4-33e7-49a3-9318-df23ce0e1e35 service nova] Releasing lock "refresh_cache-56e65553-f0ca-4d54-982b-0c40973fdf6b" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:23:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-60e06d72-cdbe-4912-9562-9df02427baeb req-35641eef-b2fa-42fb-8a45-420894ba90b1 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received event network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-60e06d72-cdbe-4912-9562-9df02427baeb req-35641eef-b2fa-42fb-8a45-420894ba90b1 service nova] Acquiring lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-60e06d72-cdbe-4912-9562-9df02427baeb req-35641eef-b2fa-42fb-8a45-420894ba90b1 service nova] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-60e06d72-cdbe-4912-9562-9df02427baeb req-35641eef-b2fa-42fb-8a45-420894ba90b1 service nova] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-60e06d72-cdbe-4912-9562-9df02427baeb req-35641eef-b2fa-42fb-8a45-420894ba90b1 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] No waiting events found dispatching network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:17 user nova-compute[74681]: WARNING nova.compute.manager [req-60e06d72-cdbe-4912-9562-9df02427baeb req-35641eef-b2fa-42fb-8a45-420894ba90b1 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received unexpected event network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 for instance with vm_state building and task_state spawning.
Aug 16 06:23:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166998.9463053, 56e65553-f0ca-4d54-982b-0c40973fdf6b => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:18 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] VM Resumed (Lifecycle Event)
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:18 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Instance spawned successfully.
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:19 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692166998.9564555, 56e65553-f0ca-4d54-982b-0c40973fdf6b => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:19 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] VM Started (Lifecycle Event)
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:23:19 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:23:19 user nova-compute[74681]: INFO nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-5b7e4ccb-3315-45a3-a289-419245fc571a req-69737336-4983-40bf-b017-35bec88eb4b8 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received event network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7e4ccb-3315-45a3-a289-419245fc571a req-69737336-4983-40bf-b017-35bec88eb4b8 service nova] Acquiring lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7e4ccb-3315-45a3-a289-419245fc571a req-69737336-4983-40bf-b017-35bec88eb4b8 service nova] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b7e4ccb-3315-45a3-a289-419245fc571a req-69737336-4983-40bf-b017-35bec88eb4b8 service nova] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-5b7e4ccb-3315-45a3-a289-419245fc571a req-69737336-4983-40bf-b017-35bec88eb4b8 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] No waiting events found dispatching network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:19 user nova-compute[74681]: WARNING nova.compute.manager [req-5b7e4ccb-3315-45a3-a289-419245fc571a req-69737336-4983-40bf-b017-35bec88eb4b8 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received unexpected event network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 for instance with vm_state building and task_state spawning.
Aug 16 06:23:19 user nova-compute[74681]: INFO nova.compute.manager [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Took 7.11 seconds to build instance.
Aug 16 06:23:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7f5e97fc-8954-4d34-b734-6b6389f65a96 tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.268s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:21 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692166986.1148114, 20509fce-ff8d-4edc-85e9-c54375c274da => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:21 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] VM Stopped (Lifecycle Event)
Aug 16 06:23:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c569abac-cd43-4252-9500-cfa639e2d540 None None] [instance: 20509fce-ff8d-4edc-85e9-c54375c274da] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:22 user nova-compute[74681]: INFO nova.compute.manager [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Terminating instance
Aug 16 06:23:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-50bab7f3-4936-4dfa-9b9e-ded3cba052ed req-7c3aca23-467f-40e9-bf30-cb9d2a9ecf63 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received event network-vif-unplugged-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50bab7f3-4936-4dfa-9b9e-ded3cba052ed req-7c3aca23-467f-40e9-bf30-cb9d2a9ecf63 service nova] Acquiring lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50bab7f3-4936-4dfa-9b9e-ded3cba052ed req-7c3aca23-467f-40e9-bf30-cb9d2a9ecf63 service nova] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-50bab7f3-4936-4dfa-9b9e-ded3cba052ed req-7c3aca23-467f-40e9-bf30-cb9d2a9ecf63 service nova] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-50bab7f3-4936-4dfa-9b9e-ded3cba052ed req-7c3aca23-467f-40e9-bf30-cb9d2a9ecf63 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] No waiting events found dispatching network-vif-unplugged-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-50bab7f3-4936-4dfa-9b9e-ded3cba052ed req-7c3aca23-467f-40e9-bf30-cb9d2a9ecf63 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received event network-vif-unplugged-f0f9e0d1-3781-45b4-87f0-066666612593 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:23:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Instance destroyed successfully.
Aug 16 06:23:23 user nova-compute[74681]: DEBUG nova.objects.instance [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lazy-loading 'resources' on Instance uuid 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-157005552',display_name='tempest-VolumesActionsTest-instance-157005552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-157005552',id=31,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:21:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b1f3324efa34f56bab9b32dff44ac74',ramdisk_id='',reservation_id='r-uqtjtvrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-13411155',owner_user_name='tempest-VolumesActionsTest-13411155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:21:39Z,user_data=None,user_id='597807248b8f4c598235cf07b48d1de5',uuid=29fd28c8-c4a0-4c2e-9256-a59fcecb79f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converting VIF {"id": "f0f9e0d1-3781-45b4-87f0-066666612593", "address": "fa:16:3e:a2:af:11", "network": {"id": "3b6290f0-9580-4551-a277-4683668d8631", "bridge": "br-int", "label": "tempest-VolumesActionsTest-761291188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1f3324efa34f56bab9b32dff44ac74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f9e0d1-37", "ovs_interfaceid": "f0f9e0d1-3781-45b4-87f0-066666612593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:af:11,bridge_name='br-int',has_traffic_filtering=True,id=f0f9e0d1-3781-45b4-87f0-066666612593,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f9e0d1-37') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG os_vif [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:af:11,bridge_name='br-int',has_traffic_filtering=True,id=f0f9e0d1-3781-45b4-87f0-066666612593,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f9e0d1-37') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0f9e0d1-37, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:23 user nova-compute[74681]: INFO os_vif [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:af:11,bridge_name='br-int',has_traffic_filtering=True,id=f0f9e0d1-3781-45b4-87f0-066666612593,network=Network(3b6290f0-9580-4551-a277-4683668d8631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f9e0d1-37')
Aug 16 06:23:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Deleting instance files /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6_del
Aug 16 06:23:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Deletion of /opt/stack/data/nova/instances/29fd28c8-c4a0-4c2e-9256-a59fcecb79f6_del complete
Aug 16 06:23:23 user nova-compute[74681]: INFO nova.compute.manager [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 06:23:23 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:23:23 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:24 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Took 0.87 seconds to deallocate network for instance.
Aug 16 06:23:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-29ab9161-df1d-4436-a8ec-4174a534e9b5 req-f77b800e-405d-4200-ade5-dd60932d41bd service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received event network-vif-deleted-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-ab5d08e3-6efe-44f9-b285-40399e185b49 req-2e13bbd4-6621-4e7a-8475-748ad67eb183 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received event network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab5d08e3-6efe-44f9-b285-40399e185b49 req-2e13bbd4-6621-4e7a-8475-748ad67eb183 service nova] Acquiring lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab5d08e3-6efe-44f9-b285-40399e185b49 req-2e13bbd4-6621-4e7a-8475-748ad67eb183 service nova] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ab5d08e3-6efe-44f9-b285-40399e185b49 req-2e13bbd4-6621-4e7a-8475-748ad67eb183 service nova] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-ab5d08e3-6efe-44f9-b285-40399e185b49 req-2e13bbd4-6621-4e7a-8475-748ad67eb183 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] No waiting events found dispatching network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:24 user nova-compute[74681]: WARNING nova.compute.manager [req-ab5d08e3-6efe-44f9-b285-40399e185b49 req-2e13bbd4-6621-4e7a-8475-748ad67eb183 service nova] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Received unexpected event network-vif-plugged-f0f9e0d1-3781-45b4-87f0-066666612593 for instance with vm_state deleted and task_state None.
Aug 16 06:23:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:25 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Deleted allocations for instance 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6
Aug 16 06:23:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-34a3e2cf-04ff-4360-a97e-de90128fd544 tempest-VolumesActionsTest-13411155 tempest-VolumesActionsTest-13411155-project-member] Lock "29fd28c8-c4a0-4c2e-9256-a59fcecb79f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "b581cf93-c19c-4d1f-a000-113a548ee755" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:23:29 user nova-compute[74681]: INFO nova.compute.claims [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Claim successful on node user
Aug 16 06:23:29 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:23:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:23:30 user nova-compute[74681]: DEBUG nova.network.neutron [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:23:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:23:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:23:30 user nova-compute[74681]: INFO nova.virt.block_device [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Booting with blank volume at /dev/vda
Aug 16 06:23:30 user nova-compute[74681]: DEBUG nova.policy [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '361d070042c54dd59f7179619de1d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd289f0a66d5047b7b1be8ca5d969eaea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:23:30 user nova-compute[74681]: DEBUG nova.network.neutron [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Successfully created port: 2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-f22dd740-c254-41c7-94cb-6146d6446811 req-c7c86814-19db-4320-9fc0-7c7474837e1f service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-changed-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-f22dd740-c254-41c7-94cb-6146d6446811 req-c7c86814-19db-4320-9fc0-7c7474837e1f service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Refreshing instance network info cache due to event network-changed-079d5905-a27c-48be-bdfe-8290b155f68e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f22dd740-c254-41c7-94cb-6146d6446811 req-c7c86814-19db-4320-9fc0-7c7474837e1f service nova] Acquiring lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f22dd740-c254-41c7-94cb-6146d6446811 req-c7c86814-19db-4320-9fc0-7c7474837e1f service nova] Acquired lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-f22dd740-c254-41c7-94cb-6146d6446811 req-c7c86814-19db-4320-9fc0-7c7474837e1f service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Refreshing network info cache for port 079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Successfully updated port: 2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquired lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-32ebc3a7-e174-4b88-81f1-7f607c37f1fb req-e63c4724-6cc3-4832-9f12-5d54eb5c4508 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-changed-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-32ebc3a7-e174-4b88-81f1-7f607c37f1fb req-e63c4724-6cc3-4832-9f12-5d54eb5c4508 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Refreshing instance network info cache due to event network-changed-2bf6831f-c3c5-419a-901e-c0e465210cec. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-32ebc3a7-e174-4b88-81f1-7f607c37f1fb req-e63c4724-6cc3-4832-9f12-5d54eb5c4508 service nova] Acquiring lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:31 user nova-compute[74681]: INFO nova.compute.manager [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Terminating instance
Aug 16 06:23:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.neutron [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updating instance_info_cache with network_info: [{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Releasing lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance network_info: |[{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-32ebc3a7-e174-4b88-81f1-7f607c37f1fb req-e63c4724-6cc3-4832-9f12-5d54eb5c4508 service nova] Acquired lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-32ebc3a7-e174-4b88-81f1-7f607c37f1fb req-e63c4724-6cc3-4832-9f12-5d54eb5c4508 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Refreshing network info cache for port 2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8ff3f98-ca32-4857-b5d5-0da2fcd37715 req-eba68d9d-87db-4fe6-ba5e-e96b14b252e0 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received event network-vif-unplugged-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8ff3f98-ca32-4857-b5d5-0da2fcd37715 req-eba68d9d-87db-4fe6-ba5e-e96b14b252e0 service nova] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8ff3f98-ca32-4857-b5d5-0da2fcd37715 req-eba68d9d-87db-4fe6-ba5e-e96b14b252e0 service nova] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d8ff3f98-ca32-4857-b5d5-0da2fcd37715 req-eba68d9d-87db-4fe6-ba5e-e96b14b252e0 service nova] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8ff3f98-ca32-4857-b5d5-0da2fcd37715 req-eba68d9d-87db-4fe6-ba5e-e96b14b252e0 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] No waiting events found dispatching network-vif-unplugged-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-d8ff3f98-ca32-4857-b5d5-0da2fcd37715 req-eba68d9d-87db-4fe6-ba5e-e96b14b252e0 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received event network-vif-unplugged-d997a09b-599b-4ba7-b9dd-86a654901271 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:23:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Instance destroyed successfully.
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lazy-loading 'resources' on Instance uuid 22008167-5859-402a-88fb-13b14bd6f48f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:20:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1673300292',display_name='tempest-AttachVolumeNegativeTest-server-1673300292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1673300292',id=30,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdKV+3E3jKMSfyqAK1qUNBNamtKMs57lfZoncoHXJc8iKZogWlw9Qb64lemR6aDVS3e8jzqB7EBmxnhUjsMakgbjT7trL6QEKH0cNsNRaBb2quLQjPLG/5HRcTOsL2u/A==',key_name='tempest-keypair-1653948621',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74c0bd15a5644f4f92453e4706aef46d',ramdisk_id='',reservation_id='r-kbxinwc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1322537387',owner_user_name='tempest-AttachVolumeNegativeTest-1322537387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:20:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de61ce701f0b41fdb80225fc0ff05fac',uuid=22008167-5859-402a-88fb-13b14bd6f48f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converting VIF {"id": "d997a09b-599b-4ba7-b9dd-86a654901271", "address": "fa:16:3e:07:ea:da", "network": {"id": "38bb26d4-edf4-4e0c-9461-ee169ee0551a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1480336906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74c0bd15a5644f4f92453e4706aef46d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd997a09b-59", "ovs_interfaceid": "d997a09b-599b-4ba7-b9dd-86a654901271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=d997a09b-599b-4ba7-b9dd-86a654901271,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd997a09b-59') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG os_vif [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=d997a09b-599b-4ba7-b9dd-86a654901271,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd997a09b-59') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd997a09b-59, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:32 user nova-compute[74681]: INFO os_vif [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=d997a09b-599b-4ba7-b9dd-86a654901271,network=Network(38bb26d4-edf4-4e0c-9461-ee169ee0551a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd997a09b-59')
Aug 16 06:23:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Deleting instance files /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f_del
Aug 16 06:23:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Deletion of /opt/stack/data/nova/instances/22008167-5859-402a-88fb-13b14bd6f48f_del complete
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-f22dd740-c254-41c7-94cb-6146d6446811 req-c7c86814-19db-4320-9fc0-7c7474837e1f service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updated VIF entry in instance network info cache for port 079d5905-a27c-48be-bdfe-8290b155f68e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-f22dd740-c254-41c7-94cb-6146d6446811 req-c7c86814-19db-4320-9fc0-7c7474837e1f service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updating instance_info_cache with network_info: [{"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f22dd740-c254-41c7-94cb-6146d6446811 req-c7c86814-19db-4320-9fc0-7c7474837e1f service nova] Releasing lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:23:32 user nova-compute[74681]: INFO nova.compute.manager [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 06:23:32 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-32ebc3a7-e174-4b88-81f1-7f607c37f1fb req-e63c4724-6cc3-4832-9f12-5d54eb5c4508 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updated VIF entry in instance network info cache for port 2bf6831f-c3c5-419a-901e-c0e465210cec. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-32ebc3a7-e174-4b88-81f1-7f607c37f1fb req-e63c4724-6cc3-4832-9f12-5d54eb5c4508 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updating instance_info_cache with network_info: [{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-32ebc3a7-e174-4b88-81f1-7f607c37f1fb req-e63c4724-6cc3-4832-9f12-5d54eb5c4508 service nova] Releasing lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'flavor' on Instance uuid b9979660-9f21-44ba-90c5-97d8314c1349 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:33 user nova-compute[74681]: INFO nova.compute.manager [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Attaching volume ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef to /dev/vdb
Aug 16 06:23:33 user nova-compute[74681]: DEBUG os_brick.utils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[34512243-3559-49d6-9cc2-5fcd8fd52cc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f5cb2b-3fc3-4d7a-9d07-132e2c6422f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[92626fef-c98b-46b4-83aa-18badba7e55a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[335a1de7-c1b2-40eb-af80-326e66ccba3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:23:33 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c075ee48-48c5-4bd4-a6bb-09220bd82a4e]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG os_brick.utils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updating existing volume attachment record: 28adfee7-b37a-4e62-83ed-2f97448b6251 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-a62646f8-2d1c-4804-9684-143753d3aa2d req-1cc12dbf-7c3f-41c5-8e7f-ca5d0c1a9b89 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received event network-vif-deleted-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:33 user nova-compute[74681]: INFO nova.compute.manager [req-a62646f8-2d1c-4804-9684-143753d3aa2d req-1cc12dbf-7c3f-41c5-8e7f-ca5d0c1a9b89 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Neutron deleted interface d997a09b-599b-4ba7-b9dd-86a654901271; detaching it from the instance and deleting it from the info cache
Aug 16 06:23:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-a62646f8-2d1c-4804-9684-143753d3aa2d req-1cc12dbf-7c3f-41c5-8e7f-ca5d0c1a9b89 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:33 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Took 0.94 seconds to deallocate network for instance.
Aug 16 06:23:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-a62646f8-2d1c-4804-9684-143753d3aa2d req-1cc12dbf-7c3f-41c5-8e7f-ca5d0c1a9b89 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Detach interface failed, port_id=d997a09b-599b-4ba7-b9dd-86a654901271, reason: Instance 22008167-5859-402a-88fb-13b14bd6f48f could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:34 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:23:34 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:23:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:34 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Deleted allocations for instance 22008167-5859-402a-88fb-13b14bd6f48f
Aug 16 06:23:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-dec4b213-1cd3-4692-be49-e2f1080543b5 tempest-AttachVolumeNegativeTest-1322537387 tempest-AttachVolumeNegativeTest-1322537387-project-member] Lock "22008167-5859-402a-88fb-13b14bd6f48f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-700aed23-618e-448a-83d2-7a159fbddfe5 req-9a0afd53-5773-4ba5-afa1-c7dd48c6ce20 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received event network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-700aed23-618e-448a-83d2-7a159fbddfe5 req-9a0afd53-5773-4ba5-afa1-c7dd48c6ce20 service nova] Acquiring lock "22008167-5859-402a-88fb-13b14bd6f48f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-700aed23-618e-448a-83d2-7a159fbddfe5 req-9a0afd53-5773-4ba5-afa1-c7dd48c6ce20 service nova] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-700aed23-618e-448a-83d2-7a159fbddfe5 req-9a0afd53-5773-4ba5-afa1-c7dd48c6ce20 service nova] Lock "22008167-5859-402a-88fb-13b14bd6f48f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-700aed23-618e-448a-83d2-7a159fbddfe5 req-9a0afd53-5773-4ba5-afa1-c7dd48c6ce20 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] No waiting events found dispatching network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:34 user nova-compute[74681]: WARNING nova.compute.manager [req-700aed23-618e-448a-83d2-7a159fbddfe5 req-9a0afd53-5773-4ba5-afa1-c7dd48c6ce20 service nova] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Received unexpected event network-vif-plugged-d997a09b-599b-4ba7-b9dd-86a654901271 for instance with vm_state deleted and task_state None.
Aug 16 06:23:35 user nova-compute[74681]: DEBUG os_brick.utils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f69b2-5d51-46f5-be23-bf39319febe7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ed879-c7fc-4a8e-afdd-9443ea7d33f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d87f60c-2d8a-4740-96a2-21015b7ade1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d0d8a6-dd27-4075-8795-f5b6d6388448]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:23:35 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:23:35 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2578d5ff-962d-4221-8823-379e0cbb160c]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG os_brick.utils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:23:35 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updating existing volume attachment record: 197c24a0-2b3f-4308-aedf-46bbfb35742c {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:23:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:38 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167003.4084573, 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:38 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] VM Stopped (Lifecycle Event)
Aug 16 06:23:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-49005645-2ef5-4aaa-9d15-1f12b55eab2d None None] [instance: 29fd28c8-c4a0-4c2e-9256-a59fcecb79f6] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:41 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updating instance_info_cache with network_info: [{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhzCBsLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:23:43 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:43 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:43 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c184424c-918d-414d-a03e-444593c51ee1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:23:43 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cf4c63-77a1-4a79-8c79-b338d10e0c1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef] added
Aug 16 06:23:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8825cce0-2084-43fd-9b8b-241198688711]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0cee1f-a765-462b-80f0-481648940ca0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yhzCBsLW {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yhzCBsLW" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4d2722-641d-487d-85f7-e97265dd7d81]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yhzCBsLW'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4002df8e-56a8-44df-ac09-49a4779db4b3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ff34ab-2adc-4962-84d3-28e8a7ae468c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:23:43 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:23:43 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5780a291-720e-413a-acaa-06c8c26d59fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef, portal: 172.16.0.220,3260]
Aug 16 06:23:43 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef, portal: 172.16.0.220,3260] successful.
Aug 16 06:23:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad6f89-f8c5-47cd-82d9-57323bc02187]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1231e715-8543-4e5a-8779-6a3e4f72bfa6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:23:43 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:43 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:23:43 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:43 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b4655f-f189-4bc5-a779-59cc9f287ffa]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhzCBsLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:43 user nova-compute[74681]: INFO nova.compute.manager [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Detaching volume 7aff920c-4261-4e2f-9f3a-90c8c57847f5
Aug 16 06:23:43 user nova-compute[74681]: INFO nova.virt.block_device [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Attempting to driver detach volume 7aff920c-4261-4e2f-9f3a-90c8c57847f5 from mountpoint /dev/vdb
Aug 16 06:23:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Attempting to detach device vdb from instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:23:43 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:23:43 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:23:43 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:23:43 user nova-compute[74681]:   <serial>7aff920c-4261-4e2f-9f3a-90c8c57847f5</serial>
Aug 16 06:23:43 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 06:23:43 user nova-compute[74681]: </disk>
Aug 16 06:23:43 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:23:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully detached device vdb from instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 from the persistent domain config.
Aug 16 06:23:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:23:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:23:43 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:23:43 user nova-compute[74681]:   <source dev="/dev/sdc"/>
Aug 16 06:23:43 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:23:43 user nova-compute[74681]:   <serial>7aff920c-4261-4e2f-9f3a-90c8c57847f5</serial>
Aug 16 06:23:43 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 06:23:43 user nova-compute[74681]: </disk>
Aug 16 06:23:43 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167024.276557, 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:23:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully detached device vdb from instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 from the live domain config.
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvkVfBqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:23:44 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23366353737393034', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366353737393034', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.130s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'flavor' on Instance uuid b9979660-9f21-44ba-90c5-97d8314c1349 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473e37d-5307-4f79-b4c3-49788402df88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:23:44 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:23:44 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:23:44 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:23:44 user nova-compute[74681]:   <serial>ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef</serial>
Aug 16 06:23:44 user nova-compute[74681]: </disk>
Aug 16 06:23:44 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcbdcda-946f-442c-ba2c-0ce912d21102]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:23:44 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:44 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:44 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 (non-flash)
Aug 16 06:23:44 user nova-compute[74681]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:44 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:44 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f946076dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dffa225-ce93-46d3-8eb3-fe190cc63d1b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c2be6-ddd8-4ddf-92fc-539f555abf91]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[79333d8b-fa0e-4508-9acb-37415acdda43]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2839a7f-e19d-4430-a02b-627ab22f5bad]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceefb306-2d6e-4623-b447-9c7ce3c6695d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[203e7c0a-6a3e-4c14-a2a9-436a39db91e1]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260]
Aug 16 06:23:44 user nova-compute[74681]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5, portal: 172.16.0.220,3260] successful.
Aug 16 06:23:44 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aff920c-4261-4e2f-9f3a-90c8c57847f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.128s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bcf26a-41af-44dc-b937-fd9306c0557c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== disconnect_volume: return (527ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:23:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] No VIF found with MAC fa:16:3e:7b:e1:4f, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d2886749-306c-446a-adcf-e393d02fe320 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.697s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:23:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Creating image(s)
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Ensure instance console log exists: /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Start _get_guest_xml network_info=[{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '197c24a0-2b3f-4308-aedf-46bbfb35742c', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvKztgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b581cf93-c19c-4d1f-a000-113a548ee755', 'attached_at': '', 'detached_at': '', 'volume_id': 'f99e586e-a625-4637-bcb1-8657ad9962f9', 'serial': 'f99e586e-a625-4637-bcb1-8657ad9962f9'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:23:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:23:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvKztgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:23:45 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:45 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:45 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5309bc-15f5-4c9c-9eae-d4ac22c6c20e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:23:45 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ce7083-f99d-4757-9cad-a4cb33ddb899]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9] added
Aug 16 06:23:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cf243c-5c63-41fe-b6b6-7c133ebc89dd]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e848e18a-de91-4e00-8d11-1c76a8224929]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUvKztgD {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUvKztgD" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[16311db5-5642-4dd0-9926-c60fe8d7cf4b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUvKztgD'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[97479bfb-978f-41d1-9952-29dbe8552a19]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf59ae4-0939-4b73-8411-041de88efece]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:45 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:45 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5016adc4-73e5-48ee-8b76-dcda19910923]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9, portal: 172.16.0.220,3260]
Aug 16 06:23:45 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9, portal: 172.16.0.220,3260] successful.
Aug 16 06:23:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'flavor' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d65ca50-9344-4dc5-aba0-f018ac6c7c47]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd2113-032c-4bd5-ba2c-b516dd4d8e0b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:45 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:45 user nova-compute[74681]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:45 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:45 user nova-compute[74681]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:45 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92e1c01a-5127-4623-b8b0-3ff31107782a tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.963s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ee3cb0-9720-4def-ab25-e316f68d6331]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvKztgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:46 user nova-compute[74681]: INFO nova.compute.manager [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Detaching volume ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef
Aug 16 06:23:46 user nova-compute[74681]: INFO nova.virt.block_device [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Attempting to driver detach volume ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef from mountpoint /dev/vdb
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Attempting to detach device vdb from instance b9979660-9f21-44ba-90c5-97d8314c1349 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:23:46 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:23:46 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:23:46 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:23:46 user nova-compute[74681]:   <serial>ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef</serial>
Aug 16 06:23:46 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:23:46 user nova-compute[74681]: </disk>
Aug 16 06:23:46 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:46 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Successfully detached device vdb from instance b9979660-9f21-44ba-90c5-97d8314c1349 from the persistent domain config.
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9979660-9f21-44ba-90c5-97d8314c1349 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:23:46 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:23:46 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:23:46 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:23:46 user nova-compute[74681]:   <serial>ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef</serial>
Aug 16 06:23:46 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:23:46 user nova-compute[74681]: </disk>
Aug 16 06:23:46 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26332616636613233', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332616636613233', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-295494951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-295494951',id=34,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-ai5gn9g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:23:30Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=b581cf93-c19c-4d1f-a000-113a548ee755,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:47:44,bridge_name='br-int',has_traffic_filtering=True,id=2bf6831f-c3c5-419a-901e-c0e465210cec,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf6831f-c3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'pci_devices' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:23:46 user nova-compute[74681]:   <uuid>b581cf93-c19c-4d1f-a000-113a548ee755</uuid>
Aug 16 06:23:46 user nova-compute[74681]:   <name>instance-00000022</name>
Aug 16 06:23:46 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:23:46 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:23:46 user nova-compute[74681]:   <metadata>
Aug 16 06:23:46 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:23:46 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:23:46 user nova-compute[74681]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-295494951</nova:name>
Aug 16 06:23:46 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:23:45</nova:creationTime>
Aug 16 06:23:46 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:23:46 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:23:46 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:23:46 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:23:46 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:23:46 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:23:46 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:23:46 user nova-compute[74681]:       <nova:owner>
Aug 16 06:23:46 user nova-compute[74681]:         <nova:user uuid="361d070042c54dd59f7179619de1d1e9">tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member</nova:user>
Aug 16 06:23:46 user nova-compute[74681]:         <nova:project uuid="d289f0a66d5047b7b1be8ca5d969eaea">tempest-ServerBootFromVolumeStableRescueTest-2074839932</nova:project>
Aug 16 06:23:46 user nova-compute[74681]:       </nova:owner>
Aug 16 06:23:46 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:23:46 user nova-compute[74681]:       <nova:ports>
Aug 16 06:23:46 user nova-compute[74681]:         <nova:port uuid="2bf6831f-c3c5-419a-901e-c0e465210cec">
Aug 16 06:23:46 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:23:46 user nova-compute[74681]:         </nova:port>
Aug 16 06:23:46 user nova-compute[74681]:       </nova:ports>
Aug 16 06:23:46 user nova-compute[74681]:     </nova:instance>
Aug 16 06:23:46 user nova-compute[74681]:   </metadata>
Aug 16 06:23:46 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:23:46 user nova-compute[74681]:     <system>
Aug 16 06:23:46 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:23:46 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:23:46 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:23:46 user nova-compute[74681]:       <entry name="serial">b581cf93-c19c-4d1f-a000-113a548ee755</entry>
Aug 16 06:23:46 user nova-compute[74681]:       <entry name="uuid">b581cf93-c19c-4d1f-a000-113a548ee755</entry>
Aug 16 06:23:46 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:23:46 user nova-compute[74681]:     </system>
Aug 16 06:23:46 user nova-compute[74681]:   </sysinfo>
Aug 16 06:23:46 user nova-compute[74681]:   <os>
Aug 16 06:23:46 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:23:46 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:23:46 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:23:46 user nova-compute[74681]:   </os>
Aug 16 06:23:46 user nova-compute[74681]:   <features>
Aug 16 06:23:46 user nova-compute[74681]:     <acpi/>
Aug 16 06:23:46 user nova-compute[74681]:     <apic/>
Aug 16 06:23:46 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:23:46 user nova-compute[74681]:   </features>
Aug 16 06:23:46 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:23:46 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:23:46 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:23:46 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:23:46 user nova-compute[74681]:   </clock>
Aug 16 06:23:46 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:23:46 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:23:46 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:23:46 user nova-compute[74681]:   </cpu>
Aug 16 06:23:46 user nova-compute[74681]:   <devices>
Aug 16 06:23:46 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:23:46 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:23:46 user nova-compute[74681]:       <source dev="/dev/sdc"/>
Aug 16 06:23:46 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:23:46 user nova-compute[74681]:       <serial>f99e586e-a625-4637-bcb1-8657ad9962f9</serial>
Aug 16 06:23:46 user nova-compute[74681]:     </disk>
Aug 16 06:23:46 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:23:46 user nova-compute[74681]:       <mac address="fa:16:3e:50:47:44"/>
Aug 16 06:23:46 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:23:46 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:23:46 user nova-compute[74681]:       <target dev="tap2bf6831f-c3"/>
Aug 16 06:23:46 user nova-compute[74681]:     </interface>
Aug 16 06:23:46 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:23:46 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/console.log" append="off"/>
Aug 16 06:23:46 user nova-compute[74681]:     </serial>
Aug 16 06:23:46 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:23:46 user nova-compute[74681]:     <video>
Aug 16 06:23:46 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:23:46 user nova-compute[74681]:     </video>
Aug 16 06:23:46 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:23:46 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:23:46 user nova-compute[74681]:     </rng>
Aug 16 06:23:46 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:23:46 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:23:46 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:23:46 user nova-compute[74681]:     </memballoon>
Aug 16 06:23:46 user nova-compute[74681]:   </devices>
Aug 16 06:23:46 user nova-compute[74681]: </domain>
Aug 16 06:23:46 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-295494951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-295494951',id=34,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-ai5gn9g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:23:30Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=b581cf93-c19c-4d1f-a000-113a548ee755,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:47:44,bridge_name='br-int',has_traffic_filtering=True,id=2bf6831f-c3c5-419a-901e-c0e465210cec,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf6831f-c3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG os_vif [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:47:44,bridge_name='br-int',has_traffic_filtering=True,id=2bf6831f-c3c5-419a-901e-c0e465210cec,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf6831f-c3') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bf6831f-c3, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bf6831f-c3, col_values=(('external_ids', {'iface-id': '2bf6831f-c3c5-419a-901e-c0e465210cec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:47:44', 'vm-uuid': 'b581cf93-c19c-4d1f-a000-113a548ee755'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:46 user nova-compute[74681]: INFO os_vif [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:47:44,bridge_name='br-int',has_traffic_filtering=True,id=2bf6831f-c3c5-419a-901e-c0e465210cec,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf6831f-c3')
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No VIF found with MAC fa:16:3e:50:47:44, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167026.9663074, b9979660-9f21-44ba-90c5-97d8314c1349 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:23:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9979660-9f21-44ba-90c5-97d8314c1349 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:23:47 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Successfully detached device vdb from instance b9979660-9f21-44ba-90c5-97d8314c1349 from the live domain config.
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yhzCBsLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:23:47 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9357443e-1189-4e30-8e90-58604f66c9b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquired lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'info_cache' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[028f11f9-3d3d-4ae8-bc6d-dceeb5a1d744]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:47 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:47 user nova-compute[74681]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:47 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:47 user nova-compute[74681]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef (non-flash)
Aug 16 06:23:47 user nova-compute[74681]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:47 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f949ebd7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[831009b4-8cc5-4e16-b3e4-8abeec541dbd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce8dd38-087a-4795-9bee-15db5e6cb12b]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c936c8-3249-44ed-b79b-bfe4736195b6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5fba7e-b2f2-4531-977e-7d6a26be34b7]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d155a2d4-d338-4fc8-a569-21ba5659631c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb2941d-1cf1-40b5-8ae3-cb0f193b12f6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef, portal: 172.16.0.220,3260]
Aug 16 06:23:47 user nova-compute[74681]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef, portal: 172.16.0.220,3260] successful.
Aug 16 06:23:47 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e4ec3-075b-4ee6-9c82-ef949a28b6ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e48b34-0c84-468f-ae7f-0d97b1640a5c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] <== disconnect_volume: return (394ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167012.796189, 22008167-5859-402a-88fb-13b14bd6f48f => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:47 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] VM Stopped (Lifecycle Event)
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c696d9e5-d023-498f-9d41-748ed815f283 None None] [instance: 22008167-5859-402a-88fb-13b14bd6f48f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updating instance_info_cache with network_info: [{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Releasing lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:23:47 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance destroyed successfully.
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'resources' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG os_vif [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2886dcc-da, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:48 user nova-compute[74681]: INFO os_vif [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da')
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsTVWxkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:23:48 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[85287444-661c-4e0d-a45f-15b2c06c6363]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531a6bd-5872-46bb-8b4c-8ebf58bce922]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:48 user nova-compute[74681]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:48 user nova-compute[74681]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f949426d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa45de8f-4703-4b2f-9395-0e9c1d5d1b0d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2b470c-b2a9-4094-b169-1fc6bc2b1b79]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee49a5-2e03-4ae8-9e6c-ff8c63af50d1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c62492-c71b-464f-8d2e-0b751d4860a9]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3303d4-8a90-44d7-b95c-e81170210c39]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3722683-f939-4e56-a246-a8dac09b1df8]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260]
Aug 16 06:23:48 user nova-compute[74681]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260] successful.
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af1e74-7c31-4791-a315-001901f10ca0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'flavor' on Instance uuid b9979660-9f21-44ba-90c5-97d8314c1349 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== disconnect_volume: return (401ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-a3d83440-1f55-44bf-b3f7-ac993e94d7a8 req-f4019fe8-8267-4316-b9a1-ee0a62878aff service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3d83440-1f55-44bf-b3f7-ac993e94d7a8 req-f4019fe8-8267-4316-b9a1-ee0a62878aff service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3d83440-1f55-44bf-b3f7-ac993e94d7a8 req-f4019fe8-8267-4316-b9a1-ee0a62878aff service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a3d83440-1f55-44bf-b3f7-ac993e94d7a8 req-f4019fe8-8267-4316-b9a1-ee0a62878aff service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-a3d83440-1f55-44bf-b3f7-ac993e94d7a8 req-f4019fe8-8267-4316-b9a1-ee0a62878aff service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:48 user nova-compute[74681]: WARNING nova.compute.manager [req-a3d83440-1f55-44bf-b3f7-ac993e94d7a8 req-f4019fe8-8267-4316-b9a1-ee0a62878aff service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state building and task_state spawning.
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Start _get_guest_xml network_info=[{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '20230635-c72c-4bab-9408-3e74034bf22b', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsTVWxkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6297f1b7-34ea-4481-8d21-ead2bf0b3d2a', 'attached_at': '', 'detached_at': '', 'volume_id': '4d096acd-4110-412e-93db-fa838b40e9ab', 'serial': '4d096acd-4110-412e-93db-fa838b40e9ab'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'numa_topology' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8d4a2ff0-5173-41b9-85f4-2b1b63e13951 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.049s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:48 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:23:48 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:23:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsTVWxkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:23:48 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:48 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:23:48 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7906b0e9-1bcb-432e-acb1-418f95aeb688]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:23:48 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb3e34c-ba37-494d-aefb-3edd3f46c484]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab] added
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a14ff44-e7db-4162-84bd-f3efb3057af1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4725de-6a24-4cd7-af19-4ac1f066e836]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsTVWxkZ {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsTVWxkZ" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2648b9-d096-4a1e-a473-0046496025a9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RsTVWxkZ'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[daab6759-c005-40b5-bab9-4153a8d28808]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2836d2-71b2-4df0-b147-655cd70fae18]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b507f336-6645-493e-8e87-b850baf9621c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260]
Aug 16 06:23:48 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260] successful.
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[90513adb-f77d-4aae-99da-26e800113cd2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0dbfca-ae5d-4f42-b5d9-fa6cf63901e3]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:48 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:23:48 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:23:48 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc45791-ea70-4e56-b528-2272a6ab981a]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:23:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsTVWxkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid '6297f1b7-34ea-4481-8d21-ead2bf0b3d2a' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid '6297f1b7-34ea-4481-8d21-ead2bf0b3d2a' (instance-0000001c)
Aug 16 06:23:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:23:49 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7431MB free_disk=25.213451385498047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a95646fe-8d93-47c7-9590-dbbb54c479d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b9979660-9f21-44ba-90c5-97d8314c1349 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 56e65553-f0ca-4d54-982b-0c40973fdf6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23439386264373734', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:23:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439386264373734', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'pci_devices' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:23:50 user nova-compute[74681]:   <uuid>6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</uuid>
Aug 16 06:23:50 user nova-compute[74681]:   <name>instance-0000001c</name>
Aug 16 06:23:50 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:23:50 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:23:50 user nova-compute[74681]:   <metadata>
Aug 16 06:23:50 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:23:50 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:23:50 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeTestJSON-server-1103772826</nova:name>
Aug 16 06:23:50 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:23:48</nova:creationTime>
Aug 16 06:23:50 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:23:50 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:23:50 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:23:50 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:23:50 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:23:50 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:23:50 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:23:50 user nova-compute[74681]:       <nova:owner>
Aug 16 06:23:50 user nova-compute[74681]:         <nova:user uuid="ca629fd2ab8b4728a772af22f19f48e1">tempest-AttachVolumeTestJSON-436096878-project-member</nova:user>
Aug 16 06:23:50 user nova-compute[74681]:         <nova:project uuid="d50b9e6e8d18446baeb39b48b22aa64d">tempest-AttachVolumeTestJSON-436096878</nova:project>
Aug 16 06:23:50 user nova-compute[74681]:       </nova:owner>
Aug 16 06:23:50 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:23:50 user nova-compute[74681]:       <nova:ports>
Aug 16 06:23:50 user nova-compute[74681]:         <nova:port uuid="f2886dcc-dad5-4242-a05f-e88b51734354">
Aug 16 06:23:50 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 06:23:50 user nova-compute[74681]:         </nova:port>
Aug 16 06:23:50 user nova-compute[74681]:       </nova:ports>
Aug 16 06:23:50 user nova-compute[74681]:     </nova:instance>
Aug 16 06:23:50 user nova-compute[74681]:   </metadata>
Aug 16 06:23:50 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:23:50 user nova-compute[74681]:     <system>
Aug 16 06:23:50 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:23:50 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:23:50 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:23:50 user nova-compute[74681]:       <entry name="serial">6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</entry>
Aug 16 06:23:50 user nova-compute[74681]:       <entry name="uuid">6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</entry>
Aug 16 06:23:50 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:23:50 user nova-compute[74681]:     </system>
Aug 16 06:23:50 user nova-compute[74681]:   </sysinfo>
Aug 16 06:23:50 user nova-compute[74681]:   <os>
Aug 16 06:23:50 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:23:50 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:23:50 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:23:50 user nova-compute[74681]:   </os>
Aug 16 06:23:50 user nova-compute[74681]:   <features>
Aug 16 06:23:50 user nova-compute[74681]:     <acpi/>
Aug 16 06:23:50 user nova-compute[74681]:     <apic/>
Aug 16 06:23:50 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:23:50 user nova-compute[74681]:   </features>
Aug 16 06:23:50 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:23:50 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:23:50 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:23:50 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:23:50 user nova-compute[74681]:   </clock>
Aug 16 06:23:50 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:23:50 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:23:50 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:23:50 user nova-compute[74681]:   </cpu>
Aug 16 06:23:50 user nova-compute[74681]:   <devices>
Aug 16 06:23:50 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:23:50 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:23:50 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk"/>
Aug 16 06:23:50 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:23:50 user nova-compute[74681]:     </disk>
Aug 16 06:23:50 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:23:50 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:23:50 user nova-compute[74681]:       <source dev="/dev/sdb"/>
Aug 16 06:23:50 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:23:50 user nova-compute[74681]:       <serial>4d096acd-4110-412e-93db-fa838b40e9ab</serial>
Aug 16 06:23:50 user nova-compute[74681]:     </disk>
Aug 16 06:23:50 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:23:50 user nova-compute[74681]:       <mac address="fa:16:3e:c6:73:6f"/>
Aug 16 06:23:50 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:23:50 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:23:50 user nova-compute[74681]:       <target dev="tapf2886dcc-da"/>
Aug 16 06:23:50 user nova-compute[74681]:     </interface>
Aug 16 06:23:50 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:23:50 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/console.log" append="off"/>
Aug 16 06:23:50 user nova-compute[74681]:     </serial>
Aug 16 06:23:50 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:23:50 user nova-compute[74681]:     <video>
Aug 16 06:23:50 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:23:50 user nova-compute[74681]:     </video>
Aug 16 06:23:50 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:23:50 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:23:50 user nova-compute[74681]:     </rng>
Aug 16 06:23:50 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:23:50 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:23:50 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:23:50 user nova-compute[74681]:     </memballoon>
Aug 16 06:23:50 user nova-compute[74681]:   </devices>
Aug 16 06:23:50 user nova-compute[74681]: </domain>
Aug 16 06:23:50 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167030.3843248, b581cf93-c19c-4d1f-a000-113a548ee755 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] VM Resumed (Lifecycle Event)
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:23:50 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance spawned successfully.
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167030.3956423, b581cf93-c19c-4d1f-a000-113a548ee755 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] VM Started (Lifecycle Event)
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-d06780d7-ad59-4b3f-b219-7907c60dfae1 req-8ab5b258-3e36-4c42-ac7b-99255a235b0e service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d06780d7-ad59-4b3f-b219-7907c60dfae1 req-8ab5b258-3e36-4c42-ac7b-99255a235b0e service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d06780d7-ad59-4b3f-b219-7907c60dfae1 req-8ab5b258-3e36-4c42-ac7b-99255a235b0e service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d06780d7-ad59-4b3f-b219-7907c60dfae1 req-8ab5b258-3e36-4c42-ac7b-99255a235b0e service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-d06780d7-ad59-4b3f-b219-7907c60dfae1 req-8ab5b258-3e36-4c42-ac7b-99255a235b0e service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:50 user nova-compute[74681]: WARNING nova.compute.manager [req-d06780d7-ad59-4b3f-b219-7907c60dfae1 req-8ab5b258-3e36-4c42-ac7b-99255a235b0e service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state building and task_state spawning.
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:23:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:23:50 user nova-compute[74681]: INFO nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:23:50 user nova-compute[74681]: INFO nova.compute.manager [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Took 21.24 seconds to build instance.
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-393fd1ed-e9b4-4dbf-8a1d-4e074b10ee29 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "b581cf93-c19c-4d1f-a000-113a548ee755" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.345s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Cannot resize image /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.objects.instance [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'migration_context' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG os_vif [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2886dcc-da, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2886dcc-da, col_values=(('external_ids', {'iface-id': 'f2886dcc-dad5-4242-a05f-e88b51734354', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:73:6f', 'vm-uuid': '6297f1b7-34ea-4481-8d21-ead2bf0b3d2a'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:23:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:50 user nova-compute[74681]: INFO os_vif [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da')
Aug 16 06:23:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:23:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:23:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-8f09d4a8-c3f0-4b3c-871f-aebb344707ca req-5e4629e7-dda0-4b77-b56b-2b353028d304 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f09d4a8-c3f0-4b3c-871f-aebb344707ca req-5e4629e7-dda0-4b77-b56b-2b353028d304 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f09d4a8-c3f0-4b3c-871f-aebb344707ca req-5e4629e7-dda0-4b77-b56b-2b353028d304 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f09d4a8-c3f0-4b3c-871f-aebb344707ca req-5e4629e7-dda0-4b77-b56b-2b353028d304 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-8f09d4a8-c3f0-4b3c-871f-aebb344707ca req-5e4629e7-dda0-4b77-b56b-2b353028d304 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:52 user nova-compute[74681]: WARNING nova.compute.manager [req-8f09d4a8-c3f0-4b3c-871f-aebb344707ca req-5e4629e7-dda0-4b77-b56b-2b353028d304 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state stopped and task_state powering-on.
Aug 16 06:23:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167034.4647026, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:54 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Resumed (Lifecycle Event)
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:23:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance rebooted successfully.
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-17a650ed-8d7f-4a4d-a55f-d5ba4d99df57 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:23:54 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167034.4671576, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:23:54 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Started (Lifecycle Event)
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.compute.manager [req-6f8560c8-2ec4-4f5a-9783-0b387e11b6d1 req-ef14c545-4377-4233-aeb1-41453952554a service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6f8560c8-2ec4-4f5a-9783-0b387e11b6d1 req-ef14c545-4377-4233-aeb1-41453952554a service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6f8560c8-2ec4-4f5a-9783-0b387e11b6d1 req-ef14c545-4377-4233-aeb1-41453952554a service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6f8560c8-2ec4-4f5a-9783-0b387e11b6d1 req-ef14c545-4377-4233-aeb1-41453952554a service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:23:54 user nova-compute[74681]: DEBUG nova.compute.manager [req-6f8560c8-2ec4-4f5a-9783-0b387e11b6d1 req-ef14c545-4377-4233-aeb1-41453952554a service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:23:54 user nova-compute[74681]: WARNING nova.compute.manager [req-6f8560c8-2ec4-4f5a-9783-0b387e11b6d1 req-ef14c545-4377-4233-aeb1-41453952554a service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state active and task_state None.
Aug 16 06:23:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:23:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:24:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:24:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:24:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:24:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:24:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "c119ab6d-f522-4c1c-ad31-c2f569482363" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:08 user nova-compute[74681]: DEBUG nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:24:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:08 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:24:08 user nova-compute[74681]: INFO nova.compute.claims [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Claim successful on node user
Aug 16 06:24:09 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:24:09 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:24:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:24:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:24:09 user nova-compute[74681]: DEBUG nova.network.neutron [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:24:09 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:24:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:24:09 user nova-compute[74681]: INFO nova.virt.block_device [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Booting with volume snapshot afc48712-c22f-4485-9c04-4daa755a3c43 at /dev/vda
Aug 16 06:24:09 user nova-compute[74681]: DEBUG nova.policy [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd0444b91944ba5b2d1e3c852456964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbdfedd72a4b38aaa5acd93ac18163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:24:10 user nova-compute[74681]: DEBUG nova.network.neutron [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Successfully created port: 5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:24:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG nova.network.neutron [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Successfully updated port: 5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "refresh_cache-c119ab6d-f522-4c1c-ad31-c2f569482363" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquired lock "refresh_cache-c119ab6d-f522-4c1c-ad31-c2f569482363" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG nova.network.neutron [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-f07c796e-7f16-4229-8b00-8bca338bd0f4 req-d48a824a-cb3b-45ed-b44f-7c1364e2d6a5 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received event network-changed-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-f07c796e-7f16-4229-8b00-8bca338bd0f4 req-d48a824a-cb3b-45ed-b44f-7c1364e2d6a5 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Refreshing instance network info cache due to event network-changed-5bb1e46c-8121-4a0b-bac7-dd198e4952fd. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f07c796e-7f16-4229-8b00-8bca338bd0f4 req-d48a824a-cb3b-45ed-b44f-7c1364e2d6a5 service nova] Acquiring lock "refresh_cache-c119ab6d-f522-4c1c-ad31-c2f569482363" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG nova.network.neutron [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG nova.network.neutron [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Updating instance_info_cache with network_info: [{"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Releasing lock "refresh_cache-c119ab6d-f522-4c1c-ad31-c2f569482363" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Instance network_info: |[{"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f07c796e-7f16-4229-8b00-8bca338bd0f4 req-d48a824a-cb3b-45ed-b44f-7c1364e2d6a5 service nova] Acquired lock "refresh_cache-c119ab6d-f522-4c1c-ad31-c2f569482363" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:24:11 user nova-compute[74681]: DEBUG nova.network.neutron [req-f07c796e-7f16-4229-8b00-8bca338bd0f4 req-d48a824a-cb3b-45ed-b44f-7c1364e2d6a5 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Refreshing network info cache for port 5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:24:12 user nova-compute[74681]: DEBUG nova.network.neutron [req-f07c796e-7f16-4229-8b00-8bca338bd0f4 req-d48a824a-cb3b-45ed-b44f-7c1364e2d6a5 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Updated VIF entry in instance network info cache for port 5bb1e46c-8121-4a0b-bac7-dd198e4952fd. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:24:12 user nova-compute[74681]: DEBUG nova.network.neutron [req-f07c796e-7f16-4229-8b00-8bca338bd0f4 req-d48a824a-cb3b-45ed-b44f-7c1364e2d6a5 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Updating instance_info_cache with network_info: [{"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f07c796e-7f16-4229-8b00-8bca338bd0f4 req-d48a824a-cb3b-45ed-b44f-7c1364e2d6a5 service nova] Releasing lock "refresh_cache-c119ab6d-f522-4c1c-ad31-c2f569482363" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:24:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG os_brick.utils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1d326c-c9fb-4482-8ba9-f5940c4a0553]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0081230a-50fe-4d31-a892-47e5b34c4fff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ff46c4-2b42-4b65-a4df-923a3d35be1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25ad660-e5bb-4f8c-8200-8ffc0de5380c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:24:15 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:24:15 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4058df41-462d-4ab2-9ab3-892c5ab37fa1]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG os_brick.utils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Updating existing volume attachment record: a7f40c16-8673-41ed-a24b-aff6847cf721 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:24:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:24:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Creating image(s)
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Ensure instance console log exists: /opt/stack/data/nova/instances/c119ab6d-f522-4c1c-ad31-c2f569482363/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Start _get_guest_xml network_info=[{"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'a7f40c16-8673-41ed-a24b-aff6847cf721', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYGHuLRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c119ab6d-f522-4c1c-ad31-c2f569482363', 'attached_at': '', 'detached_at': '', 'volume_id': '9e38dc11-e231-46d0-860b-470b2a378952', 'serial': '9e38dc11-e231-46d0-860b-470b2a378952'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:24:25 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:24:25 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYGHuLRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:24:25 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:24:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:24:25 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:24:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:24:25 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:24:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e15e2-4a4a-424f-8994-9c85cfa8e6d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:24:25 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7902db47-8a1f-4e33-b4e3-4f7a7ed74bc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952] added
Aug 16 06:24:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3bfdcc-7957-4190-9b1e-79f3771d07d8]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:24:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[110be6b0-5891-4065-b549-9afc7350a606]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iYGHuLRP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iYGHuLRP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[07743854-e6e0-457e-84b7-f95540194f44]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iYGHuLRP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f6b588-ca4d-43ae-b28d-07250dc952f6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a832f28a-33f5-4c58-afb7-4d462cece8e2]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20eae5-153b-4999-a48f-ce0a9703d027 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20eae5-153b-4999-a48f-ce0a9703d027 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20eae5-153b-4999-a48f-ce0a9703d027 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ac7f9-03dc-4641-9943-1a696bd60d2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952, portal: 172.16.0.220,3260]
Aug 16 06:24:26 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952, portal: 172.16.0.220,3260] successful.
Aug 16 06:24:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f8e8ac-b186-49b5-a7d3-43469003c8c1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee89da6f-f019-41e2-9d23-1d0ddc038cd4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20eae5-153b-4999-a48f-ce0a9703d027 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20eae5-153b-4999-a48f-ce0a9703d027 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e20eae5-153b-4999-a48f-ce0a9703d027 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)
Aug 16 06:24:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af5e810-791d-4a1a-83c6-93347ccff8b4]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYGHuLRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:24:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23737633938373434', 'path': '/dev/sde'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737633938373434', 'path': '/dev/sde'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1439611529',display_name='tempest-TestVolumeBootPattern-server-1439611529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1439611529',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-wldggh86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:24:10Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=c119ab6d-f522-4c1c-ad31-c2f569482363,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5bb1e46c-8121-4a0b-bac7-dd198e4952fd,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb1e46c-81') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.objects.instance [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'pci_devices' on Instance uuid c119ab6d-f522-4c1c-ad31-c2f569482363 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:24:27 user nova-compute[74681]:   <uuid>c119ab6d-f522-4c1c-ad31-c2f569482363</uuid>
Aug 16 06:24:27 user nova-compute[74681]:   <name>instance-00000023</name>
Aug 16 06:24:27 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:24:27 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:24:27 user nova-compute[74681]:   <metadata>
Aug 16 06:24:27 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:24:27 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:24:27 user nova-compute[74681]:       <nova:name>tempest-TestVolumeBootPattern-server-1439611529</nova:name>
Aug 16 06:24:27 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:24:25</nova:creationTime>
Aug 16 06:24:27 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:24:27 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:24:27 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:24:27 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:24:27 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:24:27 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:24:27 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:24:27 user nova-compute[74681]:       <nova:owner>
Aug 16 06:24:27 user nova-compute[74681]:         <nova:user uuid="efd0444b91944ba5b2d1e3c852456964">tempest-TestVolumeBootPattern-702107063-project-member</nova:user>
Aug 16 06:24:27 user nova-compute[74681]:         <nova:project uuid="3fbbdfedd72a4b38aaa5acd93ac18163">tempest-TestVolumeBootPattern-702107063</nova:project>
Aug 16 06:24:27 user nova-compute[74681]:       </nova:owner>
Aug 16 06:24:27 user nova-compute[74681]:       <nova:ports>
Aug 16 06:24:27 user nova-compute[74681]:         <nova:port uuid="5bb1e46c-8121-4a0b-bac7-dd198e4952fd">
Aug 16 06:24:27 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 06:24:27 user nova-compute[74681]:         </nova:port>
Aug 16 06:24:27 user nova-compute[74681]:       </nova:ports>
Aug 16 06:24:27 user nova-compute[74681]:     </nova:instance>
Aug 16 06:24:27 user nova-compute[74681]:   </metadata>
Aug 16 06:24:27 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:24:27 user nova-compute[74681]:     <system>
Aug 16 06:24:27 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:24:27 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:24:27 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:24:27 user nova-compute[74681]:       <entry name="serial">c119ab6d-f522-4c1c-ad31-c2f569482363</entry>
Aug 16 06:24:27 user nova-compute[74681]:       <entry name="uuid">c119ab6d-f522-4c1c-ad31-c2f569482363</entry>
Aug 16 06:24:27 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:24:27 user nova-compute[74681]:     </system>
Aug 16 06:24:27 user nova-compute[74681]:   </sysinfo>
Aug 16 06:24:27 user nova-compute[74681]:   <os>
Aug 16 06:24:27 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:24:27 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:24:27 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:24:27 user nova-compute[74681]:   </os>
Aug 16 06:24:27 user nova-compute[74681]:   <features>
Aug 16 06:24:27 user nova-compute[74681]:     <acpi/>
Aug 16 06:24:27 user nova-compute[74681]:     <apic/>
Aug 16 06:24:27 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:24:27 user nova-compute[74681]:   </features>
Aug 16 06:24:27 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:24:27 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:24:27 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:24:27 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:24:27 user nova-compute[74681]:   </clock>
Aug 16 06:24:27 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:24:27 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:24:27 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:24:27 user nova-compute[74681]:   </cpu>
Aug 16 06:24:27 user nova-compute[74681]:   <devices>
Aug 16 06:24:27 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:24:27 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:24:27 user nova-compute[74681]:       <source dev="/dev/sde"/>
Aug 16 06:24:27 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:24:27 user nova-compute[74681]:       <serial>9e38dc11-e231-46d0-860b-470b2a378952</serial>
Aug 16 06:24:27 user nova-compute[74681]:     </disk>
Aug 16 06:24:27 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:24:27 user nova-compute[74681]:       <mac address="fa:16:3e:51:85:34"/>
Aug 16 06:24:27 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:24:27 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:24:27 user nova-compute[74681]:       <target dev="tap5bb1e46c-81"/>
Aug 16 06:24:27 user nova-compute[74681]:     </interface>
Aug 16 06:24:27 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:24:27 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/c119ab6d-f522-4c1c-ad31-c2f569482363/console.log" append="off"/>
Aug 16 06:24:27 user nova-compute[74681]:     </serial>
Aug 16 06:24:27 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:24:27 user nova-compute[74681]:     <video>
Aug 16 06:24:27 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:24:27 user nova-compute[74681]:     </video>
Aug 16 06:24:27 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:24:27 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:24:27 user nova-compute[74681]:     </rng>
Aug 16 06:24:27 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:24:27 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:24:27 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:24:27 user nova-compute[74681]:     </memballoon>
Aug 16 06:24:27 user nova-compute[74681]:   </devices>
Aug 16 06:24:27 user nova-compute[74681]: </domain>
Aug 16 06:24:27 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1439611529',display_name='tempest-TestVolumeBootPattern-server-1439611529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1439611529',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-wldggh86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:24:10Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=c119ab6d-f522-4c1c-ad31-c2f569482363,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5bb1e46c-8121-4a0b-bac7-dd198e4952fd,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb1e46c-81') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG os_vif [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5bb1e46c-8121-4a0b-bac7-dd198e4952fd,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb1e46c-81') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bb1e46c-81, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bb1e46c-81, col_values=(('external_ids', {'iface-id': '5bb1e46c-8121-4a0b-bac7-dd198e4952fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:85:34', 'vm-uuid': 'c119ab6d-f522-4c1c-ad31-c2f569482363'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:27 user nova-compute[74681]: INFO os_vif [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5bb1e46c-8121-4a0b-bac7-dd198e4952fd,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb1e46c-81')
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:24:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No VIF found with MAC fa:16:3e:51:85:34, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:24:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-685b0ca4-2bf5-4605-8138-028a1eab9c24 req-f129ba6c-bc53-4e48-8226-dee1251fb7ca service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received event network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-685b0ca4-2bf5-4605-8138-028a1eab9c24 req-f129ba6c-bc53-4e48-8226-dee1251fb7ca service nova] Acquiring lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-685b0ca4-2bf5-4605-8138-028a1eab9c24 req-f129ba6c-bc53-4e48-8226-dee1251fb7ca service nova] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-685b0ca4-2bf5-4605-8138-028a1eab9c24 req-f129ba6c-bc53-4e48-8226-dee1251fb7ca service nova] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-685b0ca4-2bf5-4605-8138-028a1eab9c24 req-f129ba6c-bc53-4e48-8226-dee1251fb7ca service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] No waiting events found dispatching network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:24:29 user nova-compute[74681]: WARNING nova.compute.manager [req-685b0ca4-2bf5-4605-8138-028a1eab9c24 req-f129ba6c-bc53-4e48-8226-dee1251fb7ca service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received unexpected event network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd for instance with vm_state building and task_state spawning.
Aug 16 06:24:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-edb36932-6e98-4210-99e2-e41f54c72ccf req-35cf15a1-ad48-40f2-bd5f-8796edf4dab0 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received event network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-edb36932-6e98-4210-99e2-e41f54c72ccf req-35cf15a1-ad48-40f2-bd5f-8796edf4dab0 service nova] Acquiring lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-edb36932-6e98-4210-99e2-e41f54c72ccf req-35cf15a1-ad48-40f2-bd5f-8796edf4dab0 service nova] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-edb36932-6e98-4210-99e2-e41f54c72ccf req-35cf15a1-ad48-40f2-bd5f-8796edf4dab0 service nova] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-edb36932-6e98-4210-99e2-e41f54c72ccf req-35cf15a1-ad48-40f2-bd5f-8796edf4dab0 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] No waiting events found dispatching network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:24:31 user nova-compute[74681]: WARNING nova.compute.manager [req-edb36932-6e98-4210-99e2-e41f54c72ccf req-35cf15a1-ad48-40f2-bd5f-8796edf4dab0 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received unexpected event network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd for instance with vm_state building and task_state spawning.
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167071.2166808, c119ab6d-f522-4c1c-ad31-c2f569482363 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:24:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] VM Resumed (Lifecycle Event)
Aug 16 06:24:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Instance spawned successfully.
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167071.216922, c119ab6d-f522-4c1c-ad31-c2f569482363 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:24:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] VM Started (Lifecycle Event)
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:24:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:24:31 user nova-compute[74681]: INFO nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 16 06:24:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:24:31 user nova-compute[74681]: INFO nova.compute.manager [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Took 22.51 seconds to build instance.
Aug 16 06:24:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-051285ca-7d5b-4309-a94f-45303846d7fe tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.613s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:34 user nova-compute[74681]: INFO nova.compute.manager [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Terminating instance
Aug 16 06:24:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-2bad5a05-8c38-4642-a583-2b265d53fc4b req-9873c3af-5cfa-4c13-9d41-ec7d6071b6c3 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-unplugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2bad5a05-8c38-4642-a583-2b265d53fc4b req-9873c3af-5cfa-4c13-9d41-ec7d6071b6c3 service nova] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2bad5a05-8c38-4642-a583-2b265d53fc4b req-9873c3af-5cfa-4c13-9d41-ec7d6071b6c3 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2bad5a05-8c38-4642-a583-2b265d53fc4b req-9873c3af-5cfa-4c13-9d41-ec7d6071b6c3 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-2bad5a05-8c38-4642-a583-2b265d53fc4b req-9873c3af-5cfa-4c13-9d41-ec7d6071b6c3 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] No waiting events found dispatching network-vif-unplugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-2bad5a05-8c38-4642-a583-2b265d53fc4b req-9873c3af-5cfa-4c13-9d41-ec7d6071b6c3 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-unplugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Instance destroyed successfully.
Aug 16 06:24:35 user nova-compute[74681]: DEBUG nova.objects.instance [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'resources' on Instance uuid 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1387190709',display_name='tempest-ServerActionsTestOtherA-server-720646220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1387190709',id=25,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2L1ejR2vei5TDJOZbHSyBoxvQApT2+jkpRVZD90oKBxXOM2q1a3wTMe8Xu++AP0SDOe2Xi6a1YzF+6WIWoDKCBaZimySH7babwXR4TOSdLQ/i0QpfzTRR+mACQj56FfQ==',key_name='tempest-keypair-780374784',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:21:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-73tkjm38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "address": "fa:16:3e:c6:c6:78", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2b31ee4-02", "ovs_interfaceid": "a2b31ee4-02ef-4ce4-87a1-8901f392593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG os_vif [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2b31ee4-02, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:35 user nova-compute[74681]: INFO os_vif [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c6:78,bridge_name='br-int',has_traffic_filtering=True,id=a2b31ee4-02ef-4ce4-87a1-8901f392593f,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2b31ee4-02')
Aug 16 06:24:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Deleting instance files /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7_del
Aug 16 06:24:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Deletion of /opt/stack/data/nova/instances/6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7_del complete
Aug 16 06:24:35 user nova-compute[74681]: INFO nova.compute.manager [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 16 06:24:35 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:24:35 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-5118c306-a6d0-41c1-996a-b3ab7ae1691b req-201cfac2-b9bc-4776-8144-c2f554e81da3 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5118c306-a6d0-41c1-996a-b3ab7ae1691b req-201cfac2-b9bc-4776-8144-c2f554e81da3 service nova] Acquiring lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5118c306-a6d0-41c1-996a-b3ab7ae1691b req-201cfac2-b9bc-4776-8144-c2f554e81da3 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5118c306-a6d0-41c1-996a-b3ab7ae1691b req-201cfac2-b9bc-4776-8144-c2f554e81da3 service nova] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-5118c306-a6d0-41c1-996a-b3ab7ae1691b req-201cfac2-b9bc-4776-8144-c2f554e81da3 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] No waiting events found dispatching network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:24:36 user nova-compute[74681]: WARNING nova.compute.manager [req-5118c306-a6d0-41c1-996a-b3ab7ae1691b req-201cfac2-b9bc-4776-8144-c2f554e81da3 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received unexpected event network-vif-plugged-a2b31ee4-02ef-4ce4-87a1-8901f392593f for instance with vm_state active and task_state deleting.
Aug 16 06:24:36 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:36 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Took 1.38 seconds to deallocate network for instance.
Aug 16 06:24:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-9a4688da-29e5-4347-abea-7d463b7ddf40 req-fcb91c59-f1d9-47eb-9bbe-2ca8d670fb03 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Received event network-vif-deleted-a2b31ee4-02ef-4ce4-87a1-8901f392593f {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:36 user nova-compute[74681]: INFO nova.compute.manager [req-9a4688da-29e5-4347-abea-7d463b7ddf40 req-fcb91c59-f1d9-47eb-9bbe-2ca8d670fb03 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Neutron deleted interface a2b31ee4-02ef-4ce4-87a1-8901f392593f; detaching it from the instance and deleting it from the info cache
Aug 16 06:24:36 user nova-compute[74681]: DEBUG nova.network.neutron [req-9a4688da-29e5-4347-abea-7d463b7ddf40 req-fcb91c59-f1d9-47eb-9bbe-2ca8d670fb03 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-9a4688da-29e5-4347-abea-7d463b7ddf40 req-fcb91c59-f1d9-47eb-9bbe-2ca8d670fb03 service nova] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Detach interface failed, port_id=a2b31ee4-02ef-4ce4-87a1-8901f392593f, reason: Instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:37 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Deleted allocations for instance 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7
Aug 16 06:24:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-718b876d-87a6-46c3-b78f-9841b28df861 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.392s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:37 user nova-compute[74681]: INFO nova.compute.manager [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Terminating instance
Aug 16 06:24:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Instance destroyed successfully.
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.objects.instance [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'resources' on Instance uuid b9979660-9f21-44ba-90c5-97d8314c1349 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2011164207',display_name='tempest-TestStampPattern-server-2011164207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2011164207',id=32,image_ref='57583fd5-fc30-40d4-824b-8694c4dc8da9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzoECm225ySl+HyAlmG0sv7wKoEPsgT9yAcs4kwnRa7sd0iBSZuzh0d16UZNUGe8zI0GmoGVsQ+b0UCPKJRw9yS1GVP40Wte/bTkaY2V6aoCUjPKx00k6FD7VMDRaRk9A==',key_name='tempest-TestStampPattern-1999912138',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57f8c98f4c524a85bfca647755fd7d58',ramdisk_id='',reservation_id='r-sgjwa9om',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a95646fe-8d93-47c7-9590-dbbb54c479d2',image_min_disk='1',image_min_ram='0',image_owner_id='57f8c98f4c524a85bfca647755fd7d58',image_owner_project_name='tempest-TestStampPattern-699262125',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-699262125-project-member',image_user_id='2525cd466cfb4097b91557bc3f41313a',owner_project_name='tempest-TestStampPattern-699262125',owner_user_name='tempest-TestStampPattern-699262125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:21:48Z,user_data=None,user_id='2525cd466cfb4097b91557bc3f41313a',uuid=b9979660-9f21-44ba-90c5-97d8314c1349,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converting VIF {"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=079d5905-a27c-48be-bdfe-8290b155f68e,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079d5905-a2') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG os_vif [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=079d5905-a27c-48be-bdfe-8290b155f68e,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079d5905-a2') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap079d5905-a2, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:38 user nova-compute[74681]: INFO os_vif [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:e1:4f,bridge_name='br-int',has_traffic_filtering=True,id=079d5905-a27c-48be-bdfe-8290b155f68e,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079d5905-a2')
Aug 16 06:24:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Deleting instance files /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349_del
Aug 16 06:24:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Deletion of /opt/stack/data/nova/instances/b9979660-9f21-44ba-90c5-97d8314c1349_del complete
Aug 16 06:24:38 user nova-compute[74681]: INFO nova.compute.manager [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-6099b26f-1d86-4a5a-b968-46dd4c9c593a req-4d60d4b0-ce5e-4bb4-937e-ff25d7d3fe2c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-changed-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-6099b26f-1d86-4a5a-b968-46dd4c9c593a req-4d60d4b0-ce5e-4bb4-937e-ff25d7d3fe2c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Refreshing instance network info cache due to event network-changed-079d5905-a27c-48be-bdfe-8290b155f68e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6099b26f-1d86-4a5a-b968-46dd4c9c593a req-4d60d4b0-ce5e-4bb4-937e-ff25d7d3fe2c service nova] Acquiring lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6099b26f-1d86-4a5a-b968-46dd4c9c593a req-4d60d4b0-ce5e-4bb4-937e-ff25d7d3fe2c service nova] Acquired lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.network.neutron [req-6099b26f-1d86-4a5a-b968-46dd4c9c593a req-4d60d4b0-ce5e-4bb4-937e-ff25d7d3fe2c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Refreshing network info cache for port 079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-vif-unplugged-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] No waiting events found dispatching network-vif-unplugged-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-vif-unplugged-079d5905-a27c-48be-bdfe-8290b155f68e for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] Acquiring lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] Lock "b9979660-9f21-44ba-90c5-97d8314c1349-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] No waiting events found dispatching network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:24:38 user nova-compute[74681]: WARNING nova.compute.manager [req-a00edb80-49c4-4a60-b9b2-dd3de7f1be5e req-5102cdb3-3db4-48c2-a0f2-f1fe991b843c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received unexpected event network-vif-plugged-079d5905-a27c-48be-bdfe-8290b155f68e for instance with vm_state active and task_state deleting.
Aug 16 06:24:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:24:40 user nova-compute[74681]: DEBUG nova.network.neutron [req-6099b26f-1d86-4a5a-b968-46dd4c9c593a req-4d60d4b0-ce5e-4bb4-937e-ff25d7d3fe2c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updated VIF entry in instance network info cache for port 079d5905-a27c-48be-bdfe-8290b155f68e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:24:40 user nova-compute[74681]: DEBUG nova.network.neutron [req-6099b26f-1d86-4a5a-b968-46dd4c9c593a req-4d60d4b0-ce5e-4bb4-937e-ff25d7d3fe2c service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updating instance_info_cache with network_info: [{"id": "079d5905-a27c-48be-bdfe-8290b155f68e", "address": "fa:16:3e:7b:e1:4f", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079d5905-a2", "ovs_interfaceid": "079d5905-a27c-48be-bdfe-8290b155f68e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:40 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:40 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:24:40 user nova-compute[74681]: INFO nova.compute.claims [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Claim successful on node user
Aug 16 06:24:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6099b26f-1d86-4a5a-b968-46dd4c9c593a req-4d60d4b0-ce5e-4bb4-937e-ff25d7d3fe2c service nova] Releasing lock "refresh_cache-b9979660-9f21-44ba-90c5-97d8314c1349" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:24:40 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Took 2.21 seconds to deallocate network for instance.
Aug 16 06:24:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-9d4c7445-9825-4e00-a730-6e334e538717 req-552f1dea-65bc-4abd-b3d1-4cbb29ac8c30 service nova] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Received event network-vif-deleted-079d5905-a27c-48be-bdfe-8290b155f68e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:41 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:24:41 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:24:42 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.647s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:24:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.863s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:42 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:24:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:24:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:24:43 user nova-compute[74681]: DEBUG nova.policy [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '830eea7441aa4c928dcb598a555e01cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6d58d07b1145b493d5a07a40c1eb0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.957s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:43 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Deleted allocations for instance b9979660-9f21-44ba-90c5-97d8314c1349
Aug 16 06:24:43 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:24:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Creating image(s)
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-db484b94-0826-4973-bae7-7ea9f87a0018 tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "b9979660-9f21-44ba-90c5-97d8314c1349" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.785s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.230s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk 1073741824" returned: 0 in 0.054s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.246s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Cannot resize image /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'migration_context' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Ensure instance console log exists: /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updating instance_info_cache with network_info: [{"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Successfully created port: 97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:24:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Successfully updated port: 97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquired lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-a60cc809-807d-4ec1-88ce-4a9704f7617d req-8b117ae6-a578-4667-915d-84f554cb1dcf service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-changed-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-a60cc809-807d-4ec1-88ce-4a9704f7617d req-8b117ae6-a578-4667-915d-84f554cb1dcf service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Refreshing instance network info cache due to event network-changed-97185598-923f-4338-a826-e8f18738d20e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a60cc809-807d-4ec1-88ce-4a9704f7617d req-8b117ae6-a578-4667-915d-84f554cb1dcf service nova] Acquiring lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating instance_info_cache with network_info: [{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Releasing lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance network_info: |[{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a60cc809-807d-4ec1-88ce-4a9704f7617d req-8b117ae6-a578-4667-915d-84f554cb1dcf service nova] Acquired lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.neutron [req-a60cc809-807d-4ec1-88ce-4a9704f7617d req-8b117ae6-a578-4667-915d-84f554cb1dcf service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Refreshing network info cache for port 97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Start _get_guest_xml network_info=[{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:24:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:24:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1769746501',display_name='tempest-ServerRescueNegativeTestJSON-server-1769746501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1769746501',id=36,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmSo2KxM/KHqSgb3nfjTsKj9pM2kypAKT8/4qdwkDsRFDQqm4dy2PdbZHyYKvvnx8kbEFjx7CA5pnD/JVs17SbMvzdgs2hIRpWHeOUKGWZ+FywpX+QxYxzbi/t41klHZQ==',key_name='tempest-keypair-1975514318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-la5jnhhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='830eea7441aa4c928dcb598a555e01cd',uuid=7998966b-a074-4d79-bf3f-9c5b9fbc60a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:45:74,bridge_name='br-int',has_traffic_filtering=True,id=97185598-923f-4338-a826-e8f18738d20e,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97185598-92') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'pci_devices' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:24:45 user nova-compute[74681]:   <uuid>7998966b-a074-4d79-bf3f-9c5b9fbc60a9</uuid>
Aug 16 06:24:45 user nova-compute[74681]:   <name>instance-00000024</name>
Aug 16 06:24:45 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:24:45 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:24:45 user nova-compute[74681]:   <metadata>
Aug 16 06:24:45 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:24:45 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:24:45 user nova-compute[74681]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1769746501</nova:name>
Aug 16 06:24:45 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:24:45</nova:creationTime>
Aug 16 06:24:45 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:24:45 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:24:45 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:24:45 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:24:45 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:24:45 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:24:45 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:24:45 user nova-compute[74681]:       <nova:owner>
Aug 16 06:24:45 user nova-compute[74681]:         <nova:user uuid="830eea7441aa4c928dcb598a555e01cd">tempest-ServerRescueNegativeTestJSON-472247401-project-member</nova:user>
Aug 16 06:24:45 user nova-compute[74681]:         <nova:project uuid="ce6d58d07b1145b493d5a07a40c1eb0c">tempest-ServerRescueNegativeTestJSON-472247401</nova:project>
Aug 16 06:24:45 user nova-compute[74681]:       </nova:owner>
Aug 16 06:24:45 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:24:45 user nova-compute[74681]:       <nova:ports>
Aug 16 06:24:45 user nova-compute[74681]:         <nova:port uuid="97185598-923f-4338-a826-e8f18738d20e">
Aug 16 06:24:45 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 06:24:45 user nova-compute[74681]:         </nova:port>
Aug 16 06:24:45 user nova-compute[74681]:       </nova:ports>
Aug 16 06:24:45 user nova-compute[74681]:     </nova:instance>
Aug 16 06:24:45 user nova-compute[74681]:   </metadata>
Aug 16 06:24:45 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:24:45 user nova-compute[74681]:     <system>
Aug 16 06:24:45 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:24:45 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:24:45 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:24:45 user nova-compute[74681]:       <entry name="serial">7998966b-a074-4d79-bf3f-9c5b9fbc60a9</entry>
Aug 16 06:24:45 user nova-compute[74681]:       <entry name="uuid">7998966b-a074-4d79-bf3f-9c5b9fbc60a9</entry>
Aug 16 06:24:45 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:24:45 user nova-compute[74681]:     </system>
Aug 16 06:24:45 user nova-compute[74681]:   </sysinfo>
Aug 16 06:24:45 user nova-compute[74681]:   <os>
Aug 16 06:24:45 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:24:45 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:24:45 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:24:45 user nova-compute[74681]:   </os>
Aug 16 06:24:45 user nova-compute[74681]:   <features>
Aug 16 06:24:45 user nova-compute[74681]:     <acpi/>
Aug 16 06:24:45 user nova-compute[74681]:     <apic/>
Aug 16 06:24:45 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:24:45 user nova-compute[74681]:   </features>
Aug 16 06:24:45 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:24:45 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:24:45 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:24:45 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:24:45 user nova-compute[74681]:   </clock>
Aug 16 06:24:45 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:24:45 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:24:45 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:24:45 user nova-compute[74681]:   </cpu>
Aug 16 06:24:45 user nova-compute[74681]:   <devices>
Aug 16 06:24:45 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:24:45 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:24:45 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk"/>
Aug 16 06:24:45 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:24:45 user nova-compute[74681]:     </disk>
Aug 16 06:24:45 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:24:45 user nova-compute[74681]:       <mac address="fa:16:3e:de:45:74"/>
Aug 16 06:24:45 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:24:45 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:24:45 user nova-compute[74681]:       <target dev="tap97185598-92"/>
Aug 16 06:24:45 user nova-compute[74681]:     </interface>
Aug 16 06:24:45 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:24:45 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/console.log" append="off"/>
Aug 16 06:24:45 user nova-compute[74681]:     </serial>
Aug 16 06:24:45 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:24:45 user nova-compute[74681]:     <video>
Aug 16 06:24:45 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:24:45 user nova-compute[74681]:     </video>
Aug 16 06:24:45 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:24:45 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:24:45 user nova-compute[74681]:     </rng>
Aug 16 06:24:45 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:24:45 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:24:45 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:24:45 user nova-compute[74681]:     </memballoon>
Aug 16 06:24:45 user nova-compute[74681]:   </devices>
Aug 16 06:24:45 user nova-compute[74681]: </domain>
Aug 16 06:24:45 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1769746501',display_name='tempest-ServerRescueNegativeTestJSON-server-1769746501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1769746501',id=36,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmSo2KxM/KHqSgb3nfjTsKj9pM2kypAKT8/4qdwkDsRFDQqm4dy2PdbZHyYKvvnx8kbEFjx7CA5pnD/JVs17SbMvzdgs2hIRpWHeOUKGWZ+FywpX+QxYxzbi/t41klHZQ==',key_name='tempest-keypair-1975514318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-la5jnhhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='830eea7441aa4c928dcb598a555e01cd',uuid=7998966b-a074-4d79-bf3f-9c5b9fbc60a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:45:74,bridge_name='br-int',has_traffic_filtering=True,id=97185598-923f-4338-a826-e8f18738d20e,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97185598-92') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG os_vif [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:45:74,bridge_name='br-int',has_traffic_filtering=True,id=97185598-923f-4338-a826-e8f18738d20e,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97185598-92') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97185598-92, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97185598-92, col_values=(('external_ids', {'iface-id': '97185598-923f-4338-a826-e8f18738d20e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:45:74', 'vm-uuid': '7998966b-a074-4d79-bf3f-9c5b9fbc60a9'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:45 user nova-compute[74681]: INFO os_vif [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:45:74,bridge_name='br-int',has_traffic_filtering=True,id=97185598-923f-4338-a826-e8f18738d20e,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97185598-92')
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No VIF found with MAC fa:16:3e:de:45:74, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-a60cc809-807d-4ec1-88ce-4a9704f7617d req-8b117ae6-a578-4667-915d-84f554cb1dcf service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updated VIF entry in instance network info cache for port 97185598-923f-4338-a826-e8f18738d20e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG nova.network.neutron [req-a60cc809-807d-4ec1-88ce-4a9704f7617d req-8b117ae6-a578-4667-915d-84f554cb1dcf service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating instance_info_cache with network_info: [{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a60cc809-807d-4ec1-88ce-4a9704f7617d req-8b117ae6-a578-4667-915d-84f554cb1dcf service nova] Releasing lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-6c3ed21e-743d-4946-952b-11160c66b423 req-7b40f452-9844-46fe-b639-dbbf46f2ec76 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6c3ed21e-743d-4946-952b-11160c66b423 req-7b40f452-9844-46fe-b639-dbbf46f2ec76 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6c3ed21e-743d-4946-952b-11160c66b423 req-7b40f452-9844-46fe-b639-dbbf46f2ec76 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6c3ed21e-743d-4946-952b-11160c66b423 req-7b40f452-9844-46fe-b639-dbbf46f2ec76 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-6c3ed21e-743d-4946-952b-11160c66b423 req-7b40f452-9844-46fe-b639-dbbf46f2ec76 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:24:47 user nova-compute[74681]: WARNING nova.compute.manager [req-6c3ed21e-743d-4946-952b-11160c66b423 req-7b40f452-9844-46fe-b639-dbbf46f2ec76 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state building and task_state spawning.
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:24:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:24:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167089.6581783, 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:24:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] VM Resumed (Lifecycle Event)
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167075.0059233, 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:24:50 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] VM Stopped (Lifecycle Event)
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-4012c06a-2d2a-4b19-9bb5-516dd60492ff req-039469c6-8450-4097-a70a-2bf7e7dd33e9 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4012c06a-2d2a-4b19-9bb5-516dd60492ff req-039469c6-8450-4097-a70a-2bf7e7dd33e9 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4012c06a-2d2a-4b19-9bb5-516dd60492ff req-039469c6-8450-4097-a70a-2bf7e7dd33e9 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4012c06a-2d2a-4b19-9bb5-516dd60492ff req-039469c6-8450-4097-a70a-2bf7e7dd33e9 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-4012c06a-2d2a-4b19-9bb5-516dd60492ff req-039469c6-8450-4097-a70a-2bf7e7dd33e9 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:24:50 user nova-compute[74681]: WARNING nova.compute.manager [req-4012c06a-2d2a-4b19-9bb5-516dd60492ff req-039469c6-8450-4097-a70a-2bf7e7dd33e9 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state building and task_state spawning.
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1c53fbd5-0bfd-4389-97bd-a874fede9183 None None] [instance: 6a6d33fb-b7c0-48f7-aa3a-0cb65c6849c7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:24:50 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:24:50 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7475MB free_disk=24.27285385131836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:24:50 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance spawned successfully.
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:24:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167089.658839, 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:24:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] VM Started (Lifecycle Event)
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:24:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a95646fe-8d93-47c7-9590-dbbb54c479d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 56e65553-f0ca-4d54-982b-0c40973fdf6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance c119ab6d-f522-4c1c-ad31-c2f569482363 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:24:50 user nova-compute[74681]: INFO nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Took 6.99 seconds to spawn the instance on the hypervisor.
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:24:50 user nova-compute[74681]: INFO nova.compute.manager [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Took 9.87 seconds to build instance.
Aug 16 06:24:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1d523f67-19c0-48d8-8eb4-d5d1e70edd05 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.730s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:24:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:24:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:24:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:53 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167078.4285622, b9979660-9f21-44ba-90c5-97d8314c1349 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:24:53 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] VM Stopped (Lifecycle Event)
Aug 16 06:24:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-421746ae-4405-4c6e-8991-1f703410eee6 None None] [instance: b9979660-9f21-44ba-90c5-97d8314c1349] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:24:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:24:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "56e65553-f0ca-4d54-982b-0c40973fdf6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:02 user nova-compute[74681]: INFO nova.compute.manager [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Terminating instance
Aug 16 06:25:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-c8af2274-2ba3-413b-a753-b9dbeae5f5c1 req-8c56a1b9-10db-4232-be04-570b0f4db548 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received event network-vif-unplugged-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c8af2274-2ba3-413b-a753-b9dbeae5f5c1 req-8c56a1b9-10db-4232-be04-570b0f4db548 service nova] Acquiring lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c8af2274-2ba3-413b-a753-b9dbeae5f5c1 req-8c56a1b9-10db-4232-be04-570b0f4db548 service nova] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c8af2274-2ba3-413b-a753-b9dbeae5f5c1 req-8c56a1b9-10db-4232-be04-570b0f4db548 service nova] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-c8af2274-2ba3-413b-a753-b9dbeae5f5c1 req-8c56a1b9-10db-4232-be04-570b0f4db548 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] No waiting events found dispatching network-vif-unplugged-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-c8af2274-2ba3-413b-a753-b9dbeae5f5c1 req-8c56a1b9-10db-4232-be04-570b0f4db548 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received event network-vif-unplugged-3382af8e-8be9-44cc-8746-42d13e140363 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:25:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Instance destroyed successfully.
Aug 16 06:25:02 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lazy-loading 'resources' on Instance uuid 56e65553-f0ca-4d54-982b-0c40973fdf6b {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1300516611',display_name='tempest-VolumesNegativeTest-instance-1300516611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1300516611',id=33,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:23:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='263626a2961b45609a4307552afc9ef8',ramdisk_id='',reservation_id='r-4znkv0d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-92364969',owner_user_name='tempest-VolumesNegativeTest-92364969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:23:19Z,user_data=None,user_id='4a48918c7f8f465695adf91994fee4c2',uuid=56e65553-f0ca-4d54-982b-0c40973fdf6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Converting VIF {"id": "3382af8e-8be9-44cc-8746-42d13e140363", "address": "fa:16:3e:d8:0e:5c", "network": {"id": "2c5d001c-93c4-4b48-af22-3bcc222b4de6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1efa6da603c04f6daaa6b9826ef50543", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3382af8e-8b", "ovs_interfaceid": "3382af8e-8be9-44cc-8746-42d13e140363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:0e:5c,bridge_name='br-int',has_traffic_filtering=True,id=3382af8e-8be9-44cc-8746-42d13e140363,network=Network(2c5d001c-93c4-4b48-af22-3bcc222b4de6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3382af8e-8b') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG os_vif [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:0e:5c,bridge_name='br-int',has_traffic_filtering=True,id=3382af8e-8be9-44cc-8746-42d13e140363,network=Network(2c5d001c-93c4-4b48-af22-3bcc222b4de6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3382af8e-8b') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3382af8e-8b, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:25:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:25:02 user nova-compute[74681]: INFO os_vif [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:0e:5c,bridge_name='br-int',has_traffic_filtering=True,id=3382af8e-8be9-44cc-8746-42d13e140363,network=Network(2c5d001c-93c4-4b48-af22-3bcc222b4de6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3382af8e-8b')
Aug 16 06:25:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Deleting instance files /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b_del
Aug 16 06:25:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Deletion of /opt/stack/data/nova/instances/56e65553-f0ca-4d54-982b-0c40973fdf6b_del complete
Aug 16 06:25:03 user nova-compute[74681]: INFO nova.compute.manager [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 06:25:03 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:25:03 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:25:03 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:25:04 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Took 1.50 seconds to deallocate network for instance.
Aug 16 06:25:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG nova.compute.manager [req-f6411557-0153-4326-a2e5-628136e252c7 req-4aabb19b-0135-4aaf-9009-b677e9ac4ce0 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received event network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f6411557-0153-4326-a2e5-628136e252c7 req-4aabb19b-0135-4aaf-9009-b677e9ac4ce0 service nova] Acquiring lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f6411557-0153-4326-a2e5-628136e252c7 req-4aabb19b-0135-4aaf-9009-b677e9ac4ce0 service nova] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f6411557-0153-4326-a2e5-628136e252c7 req-4aabb19b-0135-4aaf-9009-b677e9ac4ce0 service nova] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG nova.compute.manager [req-f6411557-0153-4326-a2e5-628136e252c7 req-4aabb19b-0135-4aaf-9009-b677e9ac4ce0 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] No waiting events found dispatching network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:04 user nova-compute[74681]: WARNING nova.compute.manager [req-f6411557-0153-4326-a2e5-628136e252c7 req-4aabb19b-0135-4aaf-9009-b677e9ac4ce0 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received unexpected event network-vif-plugged-3382af8e-8be9-44cc-8746-42d13e140363 for instance with vm_state deleted and task_state None.
Aug 16 06:25:04 user nova-compute[74681]: DEBUG nova.compute.manager [req-f6411557-0153-4326-a2e5-628136e252c7 req-4aabb19b-0135-4aaf-9009-b677e9ac4ce0 service nova] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Received event network-vif-deleted-3382af8e-8be9-44cc-8746-42d13e140363 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:25:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:05 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Deleted allocations for instance 56e65553-f0ca-4d54-982b-0c40973fdf6b
Aug 16 06:25:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d27d0b61-7a8f-4384-af74-64a2eaa3e5bf tempest-VolumesNegativeTest-92364969 tempest-VolumesNegativeTest-92364969-project-member] Lock "56e65553-f0ca-4d54-982b-0c40973fdf6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.889s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:17 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167102.9166405, 56e65553-f0ca-4d54-982b-0c40973fdf6b => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:25:17 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] VM Stopped (Lifecycle Event)
Aug 16 06:25:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-645b2fa1-6eba-4a11-bf58-e1f620a6cb53 None None] [instance: 56e65553-f0ca-4d54-982b-0c40973fdf6b] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:20 user nova-compute[74681]: INFO nova.compute.manager [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Rescuing
Aug 16 06:25:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:25:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquired lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:25:20 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:25:20 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updating instance_info_cache with network_info: [{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:25:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Releasing lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:25:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1f1ad155-d8ab-4586-b064-6099f65457a2 req-eb1dd4f6-405a-4d59-a1a7-97aee54b5b8f service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1f1ad155-d8ab-4586-b064-6099f65457a2 req-eb1dd4f6-405a-4d59-a1a7-97aee54b5b8f service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1f1ad155-d8ab-4586-b064-6099f65457a2 req-eb1dd4f6-405a-4d59-a1a7-97aee54b5b8f service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1f1ad155-d8ab-4586-b064-6099f65457a2 req-eb1dd4f6-405a-4d59-a1a7-97aee54b5b8f service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-1f1ad155-d8ab-4586-b064-6099f65457a2 req-eb1dd4f6-405a-4d59-a1a7-97aee54b5b8f service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:21 user nova-compute[74681]: WARNING nova.compute.manager [req-1f1ad155-d8ab-4586-b064-6099f65457a2 req-eb1dd4f6-405a-4d59-a1a7-97aee54b5b8f service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state active and task_state rescuing.
Aug 16 06:25:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:21 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance destroyed successfully.
Aug 16 06:25:21 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Attempting a stable device rescue
Aug 16 06:25:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74681) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance directory exists: not creating {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 06:25:21 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Creating image(s)
Aug 16 06:25:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "/opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "/opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "/opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'trusted_certs' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "71b74262b0310192162518329b92d99bb2a24f61" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "71b74262b0310192162518329b92d99bb2a24f61" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG nova.virt.images [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] 62d21efd-38dc-41ee-a2ce-7d181c40ca48 was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61.part /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG nova.compute.manager [req-f67a7965-d471-4ed1-b6ab-1ebc5609efa3 req-4249eb08-1592-4ab7-9362-9f92492f7fc8 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f67a7965-d471-4ed1-b6ab-1ebc5609efa3 req-4249eb08-1592-4ab7-9362-9f92492f7fc8 service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f67a7965-d471-4ed1-b6ab-1ebc5609efa3 req-4249eb08-1592-4ab7-9362-9f92492f7fc8 service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f67a7965-d471-4ed1-b6ab-1ebc5609efa3 req-4249eb08-1592-4ab7-9362-9f92492f7fc8 service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG nova.compute.manager [req-f67a7965-d471-4ed1-b6ab-1ebc5609efa3 req-4249eb08-1592-4ab7-9362-9f92492f7fc8 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:23 user nova-compute[74681]: WARNING nova.compute.manager [req-f67a7965-d471-4ed1-b6ab-1ebc5609efa3 req-4249eb08-1592-4ab7-9362-9f92492f7fc8 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state active and task_state rescuing.
Aug 16 06:25:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61.part /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61.converted" returned: 0 in 0.567s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "71b74262b0310192162518329b92d99bb2a24f61" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.240s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "71b74262b0310192162518329b92d99bb2a24f61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "71b74262b0310192162518329b92d99bb2a24f61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61 --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61 --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61,backing_fmt=raw /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61,backing_fmt=raw /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue" returned: 0 in 0.064s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "71b74262b0310192162518329b92d99bb2a24f61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'migration_context' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Start _get_guest_xml network_info=[{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "vif_mac": "fa:16:3e:50:47:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '62d21efd-38dc-41ee-a2ce-7d181c40ca48', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '197c24a0-2b3f-4308-aedf-46bbfb35742c', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvKztgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b581cf93-c19c-4d1f-a000-113a548ee755', 'attached_at': '', 'detached_at': '', 'volume_id': 'f99e586e-a625-4637-bcb1-8657ad9962f9', 'serial': 'f99e586e-a625-4637-bcb1-8657ad9962f9'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'resources' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'numa_topology' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:24 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:25:24 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'vcpu_model' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvKztgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:25:24 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:25:24 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:25:24 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc964196-4925-489e-b0d2-bf22ce485ea0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PUvKztgD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 06:25:24 user nova-compute[74681]: node.name = iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9
Aug 16 06:25:24 user nova-compute[74681]: node.tpgt = -1
Aug 16 06:25:24 user nova-compute[74681]: node.startup = automatic
Aug 16 06:25:24 user nova-compute[74681]: node.leading_login = No
Aug 16 06:25:24 user nova-compute[74681]: iface.iscsi_ifacename = default
Aug 16 06:25:24 user nova-compute[74681]: iface.net_ifacename = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.ipaddress = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.prefix_len = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.hwaddress = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.transport_name = tcp
Aug 16 06:25:24 user nova-compute[74681]: iface.initiatorname = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.state = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.vlan_id = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.vlan_priority = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.vlan_state = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.iface_num = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.mtu = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.port = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.bootproto = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.subnet_mask = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.gateway = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.dhcp_alt_client_id = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.dhcp_dns = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.dhcp_learn_iqn = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.dhcp_vendor_id_state = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.dhcp_vendor_id = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.dhcp_slp_da = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.fragmentation = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.gratuitous_arp = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.incoming_forwarding = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.tos_state = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.tos = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.ttl = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.delayed_ack = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.tcp_nagle = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.tcp_wsf_state = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.tcp_wsf = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.tcp_timer_scale = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.tcp_timestamp = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.redirect = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.def_task_mgmt_timeout = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.header_digest = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.data_digest = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.immediate_data = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.initial_r2t = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.data_seq_inorder = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.data_pdu_inorder = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.erl = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.max_receive_data_len = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.first_burst_len = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.max_outstanding_r2t = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.max_burst_len = 0
Aug 16 06:25:24 user nova-compute[74681]: iface.chap_auth = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.bidi_chap = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.strict_login_compliance = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.discovery_auth = <empty>
Aug 16 06:25:24 user nova-compute[74681]: iface.discovery_logout = <empty>
Aug 16 06:25:24 user nova-compute[74681]: node.discovery_address = <empty>
Aug 16 06:25:24 user nova-compute[74681]: node.discovery_port = 0
Aug 16 06:25:24 user nova-compute[74681]: node.discovery_type = static
Aug 16 06:25:24 user nova-compute[74681]: node.session.initial_cmdsn = 0
Aug 16 06:25:24 user nova-compute[74681]: node.session.initial_login_retry_max = 8
Aug 16 06:25:24 user nova-compute[74681]: node.session.xmit_thread_priority = -20
Aug 16 06:25:24 user nova-compute[74681]: node.session.cmds_max = 128
Aug 16 06:25:24 user nova-compute[74681]: node.session.queue_depth = 32
Aug 16 06:25:24 user nova-compute[74681]: node.session.nr_sessions = 1
Aug 16 06:25:24 user nova-compute[74681]: node.session.auth.authmethod = CHAP
Aug 16 06:25:24 user nova-compute[74681]: node.session.auth.username = PUvKztgD
Aug 16 06:25:24 user nova-compute[74681]: node.session.auth.password = ***
Aug 16 06:25:24 user nova-compute[74681]: node.session.auth.username_in = <empty>
Aug 16 06:25:24 user nova-compute[74681]: node.session.auth.password_in = <empty>
Aug 16 06:25:24 user nova-compute[74681]: node.session.auth.chap_algs = MD5
Aug 16 06:25:24 user nova-compute[74681]: node.session.timeo.replacement_timeout = 120
Aug 16 06:25:24 user nova-compute[74681]: node.session.err_timeo.abort_timeout = 15
Aug 16 06:25:24 user nova-compute[74681]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 06:25:24 user nova-compute[74681]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 06:25:24 user nova-compute[74681]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.FastAbort = Yes
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.InitialR2T = No
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.ImmediateData = Yes
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.MaxConnections = 1
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 06:25:24 user nova-compute[74681]: node.session.iscsi.ERL = 0
Aug 16 06:25:24 user nova-compute[74681]: node.session.scan = manual
Aug 16 06:25:24 user nova-compute[74681]: node.session.reopen_max = 0
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].address = 172.16.0.220
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].port = 3260
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].startup = manual
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].tcp.window_size = 524288
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].tcp.type_of_service = 0
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].timeo.logout_timeout = 15
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].timeo.login_timeout = 15
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].timeo.auth_timeout = 45
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].iscsi.DataDigest = None
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].iscsi.IFMarker = No
Aug 16 06:25:24 user nova-compute[74681]: node.conn[0].iscsi.OFMarker = No
Aug 16 06:25:24 user nova-compute[74681]: # END RECORD
Aug 16 06:25:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f97aded-c60e-42e5-9fbd-711028555c7b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c892604-4278-440f-be82-0da194cec377]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUvKztgD {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUvKztgD" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f13be-f244-496a-b7b7-0c0b8316f37b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUvKztgD'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[810627d0-e2fd-47e3-b320-f4aa183eaa82]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6479ced4-dfcb-4b5c-a351-be9d9e56bd41]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:25:24 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:25:24 user nova-compute[74681]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)
Aug 16 06:25:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:25:24 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:25:24 user nova-compute[74681]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)
Aug 16 06:25:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] HCTL ('34', '0', '0', 0) found on session 33 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e17e91a-3340-4645-9ddd-9e13cf177a8b]: (4, ('0 0 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching for a device in session 33 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvKztgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.334s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] <== connect_volume: return (335ms) {'type': 'block', 'scsi_wwn': '26332616636613233', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332616636613233', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-295494951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-295494951',id=34,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:23:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-ai5gn9g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:23:51Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=b581cf93-c19c-4d1f-a000-113a548ee755,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "vif_mac": "fa:16:3e:50:47:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "vif_mac": "fa:16:3e:50:47:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:47:44,bridge_name='br-int',has_traffic_filtering=True,id=2bf6831f-c3c5-419a-901e-c0e465210cec,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf6831f-c3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'pci_devices' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:25:24 user nova-compute[74681]:   <uuid>b581cf93-c19c-4d1f-a000-113a548ee755</uuid>
Aug 16 06:25:24 user nova-compute[74681]:   <name>instance-00000022</name>
Aug 16 06:25:24 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:25:24 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:25:24 user nova-compute[74681]:   <metadata>
Aug 16 06:25:24 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:25:24 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:25:24 user nova-compute[74681]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-295494951</nova:name>
Aug 16 06:25:24 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:25:24</nova:creationTime>
Aug 16 06:25:24 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:25:24 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:25:24 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:25:24 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:25:24 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:25:24 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:25:24 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:25:24 user nova-compute[74681]:       <nova:owner>
Aug 16 06:25:24 user nova-compute[74681]:         <nova:user uuid="361d070042c54dd59f7179619de1d1e9">tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member</nova:user>
Aug 16 06:25:24 user nova-compute[74681]:         <nova:project uuid="d289f0a66d5047b7b1be8ca5d969eaea">tempest-ServerBootFromVolumeStableRescueTest-2074839932</nova:project>
Aug 16 06:25:24 user nova-compute[74681]:       </nova:owner>
Aug 16 06:25:24 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:25:24 user nova-compute[74681]:       <nova:ports>
Aug 16 06:25:24 user nova-compute[74681]:         <nova:port uuid="2bf6831f-c3c5-419a-901e-c0e465210cec">
Aug 16 06:25:24 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:25:24 user nova-compute[74681]:         </nova:port>
Aug 16 06:25:24 user nova-compute[74681]:       </nova:ports>
Aug 16 06:25:24 user nova-compute[74681]:     </nova:instance>
Aug 16 06:25:24 user nova-compute[74681]:   </metadata>
Aug 16 06:25:24 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:25:24 user nova-compute[74681]:     <system>
Aug 16 06:25:24 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:25:24 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:25:24 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:25:24 user nova-compute[74681]:       <entry name="serial">b581cf93-c19c-4d1f-a000-113a548ee755</entry>
Aug 16 06:25:24 user nova-compute[74681]:       <entry name="uuid">b581cf93-c19c-4d1f-a000-113a548ee755</entry>
Aug 16 06:25:24 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:25:24 user nova-compute[74681]:     </system>
Aug 16 06:25:24 user nova-compute[74681]:   </sysinfo>
Aug 16 06:25:24 user nova-compute[74681]:   <os>
Aug 16 06:25:24 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:25:24 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:25:24 user nova-compute[74681]:   </os>
Aug 16 06:25:24 user nova-compute[74681]:   <features>
Aug 16 06:25:24 user nova-compute[74681]:     <acpi/>
Aug 16 06:25:24 user nova-compute[74681]:     <apic/>
Aug 16 06:25:24 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:25:24 user nova-compute[74681]:   </features>
Aug 16 06:25:24 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:25:24 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:25:24 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:25:24 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:25:24 user nova-compute[74681]:   </clock>
Aug 16 06:25:24 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:25:24 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:25:24 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:25:24 user nova-compute[74681]:   </cpu>
Aug 16 06:25:24 user nova-compute[74681]:   <devices>
Aug 16 06:25:24 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:25:24 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:25:24 user nova-compute[74681]:       <source dev="/dev/sdc"/>
Aug 16 06:25:24 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:25:24 user nova-compute[74681]:       <serial>f99e586e-a625-4637-bcb1-8657ad9962f9</serial>
Aug 16 06:25:24 user nova-compute[74681]:     </disk>
Aug 16 06:25:24 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:25:24 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:25:24 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue"/>
Aug 16 06:25:24 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:25:24 user nova-compute[74681]:       <boot order="1"/>
Aug 16 06:25:24 user nova-compute[74681]:     </disk>
Aug 16 06:25:24 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:25:24 user nova-compute[74681]:       <mac address="fa:16:3e:50:47:44"/>
Aug 16 06:25:24 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:25:24 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:25:24 user nova-compute[74681]:       <target dev="tap2bf6831f-c3"/>
Aug 16 06:25:24 user nova-compute[74681]:     </interface>
Aug 16 06:25:24 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:25:24 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/console.log" append="off"/>
Aug 16 06:25:24 user nova-compute[74681]:     </serial>
Aug 16 06:25:24 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:25:24 user nova-compute[74681]:     <video>
Aug 16 06:25:24 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:25:24 user nova-compute[74681]:     </video>
Aug 16 06:25:24 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:25:24 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:25:24 user nova-compute[74681]:     </rng>
Aug 16 06:25:24 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:25:24 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:25:24 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:25:24 user nova-compute[74681]:     </memballoon>
Aug 16 06:25:24 user nova-compute[74681]:   </devices>
Aug 16 06:25:24 user nova-compute[74681]: </domain>
Aug 16 06:25:24 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:25:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance destroyed successfully.
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:25:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No VIF found with MAC fa:16:3e:50:47:44, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:25:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a78b221a-c82c-47b3-94a2-45a29a60af50 req-46145820-7ed2-4d5d-a3c7-0f2845e5c4ec service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a78b221a-c82c-47b3-94a2-45a29a60af50 req-46145820-7ed2-4d5d-a3c7-0f2845e5c4ec service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a78b221a-c82c-47b3-94a2-45a29a60af50 req-46145820-7ed2-4d5d-a3c7-0f2845e5c4ec service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a78b221a-c82c-47b3-94a2-45a29a60af50 req-46145820-7ed2-4d5d-a3c7-0f2845e5c4ec service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a78b221a-c82c-47b3-94a2-45a29a60af50 req-46145820-7ed2-4d5d-a3c7-0f2845e5c4ec service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:26 user nova-compute[74681]: WARNING nova.compute.manager [req-a78b221a-c82c-47b3-94a2-45a29a60af50 req-46145820-7ed2-4d5d-a3c7-0f2845e5c4ec service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state active and task_state rescuing.
Aug 16 06:25:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-0bedc16e-3599-443e-b70c-62b8a534ce73 req-86c81541-57ed-47a7-9c5e-0ef57ce276da service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0bedc16e-3599-443e-b70c-62b8a534ce73 req-86c81541-57ed-47a7-9c5e-0ef57ce276da service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0bedc16e-3599-443e-b70c-62b8a534ce73 req-86c81541-57ed-47a7-9c5e-0ef57ce276da service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0bedc16e-3599-443e-b70c-62b8a534ce73 req-86c81541-57ed-47a7-9c5e-0ef57ce276da service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-0bedc16e-3599-443e-b70c-62b8a534ce73 req-86c81541-57ed-47a7-9c5e-0ef57ce276da service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:28 user nova-compute[74681]: WARNING nova.compute.manager [req-0bedc16e-3599-443e-b70c-62b8a534ce73 req-86c81541-57ed-47a7-9c5e-0ef57ce276da service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state active and task_state rescuing.
Aug 16 06:25:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for b581cf93-c19c-4d1f-a000-113a548ee755 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167128.9485662, b581cf93-c19c-4d1f-a000-113a548ee755 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:25:28 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] VM Resumed (Lifecycle Event)
Aug 16 06:25:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b4dbd649-5429-45ea-964b-b208403f59ef tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:25:29 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 06:25:29 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167128.9539216, b581cf93-c19c-4d1f-a000-113a548ee755 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:25:29 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] VM Started (Lifecycle Event)
Aug 16 06:25:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:25:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:25:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:25:30 user nova-compute[74681]: INFO nova.compute.claims [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Claim successful on node user
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:25:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.policy [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '586e737fe78c4bf180d51f0470bd8648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ba755546fe440591b1292c5d74a8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:25:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Creating image(s)
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "/opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "/opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "/opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.262s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Successfully created port: f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk 1073741824" returned: 0 in 0.070s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Cannot resize image /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'migration_context' on Instance uuid 6370394e-c0c1-40e2-9693-b5d5a333289d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Ensure instance console log exists: /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Successfully updated port: f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquired lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef284ed7-3f19-4d24-9ca5-8aea244cbf72 req-6d8454d3-0ec2-45e0-872c-a69343b42488 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received event network-changed-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-ef284ed7-3f19-4d24-9ca5-8aea244cbf72 req-6d8454d3-0ec2-45e0-872c-a69343b42488 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Refreshing instance network info cache due to event network-changed-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef284ed7-3f19-4d24-9ca5-8aea244cbf72 req-6d8454d3-0ec2-45e0-872c-a69343b42488 service nova] Acquiring lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Updating instance_info_cache with network_info: [{"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Releasing lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Instance network_info: |[{"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef284ed7-3f19-4d24-9ca5-8aea244cbf72 req-6d8454d3-0ec2-45e0-872c-a69343b42488 service nova] Acquired lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-ef284ed7-3f19-4d24-9ca5-8aea244cbf72 req-6d8454d3-0ec2-45e0-872c-a69343b42488 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Refreshing network info cache for port f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Start _get_guest_xml network_info=[{"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:25:33 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:25:33 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2047769346',display_name='tempest-VolumesSnapshotTestJSON-instance-2047769346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2047769346',id=37,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD314Khrzr+lhybFGQApnSELtS9qoWvnJgGJktl5XgTnlwY2ZhmltZbxFpI+MH8X4Ptj1oh5yB5nU79b2bQ0lRRXX77QZKEDci7cpitr0kqEopcvG/VAbzBHBi0xX1HtVA==',key_name='tempest-keypair-2022894617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01ba755546fe440591b1292c5d74a8f2',ramdisk_id='',reservation_id='r-do7qt8dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-848952719',owner_user_name='tempest-VolumesSnapshotTestJSON-848952719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:25:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='586e737fe78c4bf180d51f0470bd8648',uuid=6370394e-c0c1-40e2-9693-b5d5a333289d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converting VIF {"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:5d:4a,bridge_name='br-int',has_traffic_filtering=True,id=f76ff58a-b1fe-472b-a4d4-92b2ca009d8a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76ff58a-b1') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'pci_devices' on Instance uuid 6370394e-c0c1-40e2-9693-b5d5a333289d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:25:33 user nova-compute[74681]:   <uuid>6370394e-c0c1-40e2-9693-b5d5a333289d</uuid>
Aug 16 06:25:33 user nova-compute[74681]:   <name>instance-00000025</name>
Aug 16 06:25:33 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:25:33 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:25:33 user nova-compute[74681]:   <metadata>
Aug 16 06:25:33 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:25:33 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:25:33 user nova-compute[74681]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2047769346</nova:name>
Aug 16 06:25:33 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:25:33</nova:creationTime>
Aug 16 06:25:33 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:25:33 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:25:33 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:25:33 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:25:33 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:25:33 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:25:33 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:25:33 user nova-compute[74681]:       <nova:owner>
Aug 16 06:25:33 user nova-compute[74681]:         <nova:user uuid="586e737fe78c4bf180d51f0470bd8648">tempest-VolumesSnapshotTestJSON-848952719-project-member</nova:user>
Aug 16 06:25:33 user nova-compute[74681]:         <nova:project uuid="01ba755546fe440591b1292c5d74a8f2">tempest-VolumesSnapshotTestJSON-848952719</nova:project>
Aug 16 06:25:33 user nova-compute[74681]:       </nova:owner>
Aug 16 06:25:33 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:25:33 user nova-compute[74681]:       <nova:ports>
Aug 16 06:25:33 user nova-compute[74681]:         <nova:port uuid="f76ff58a-b1fe-472b-a4d4-92b2ca009d8a">
Aug 16 06:25:33 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 06:25:33 user nova-compute[74681]:         </nova:port>
Aug 16 06:25:33 user nova-compute[74681]:       </nova:ports>
Aug 16 06:25:33 user nova-compute[74681]:     </nova:instance>
Aug 16 06:25:33 user nova-compute[74681]:   </metadata>
Aug 16 06:25:33 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:25:33 user nova-compute[74681]:     <system>
Aug 16 06:25:33 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:25:33 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:25:33 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:25:33 user nova-compute[74681]:       <entry name="serial">6370394e-c0c1-40e2-9693-b5d5a333289d</entry>
Aug 16 06:25:33 user nova-compute[74681]:       <entry name="uuid">6370394e-c0c1-40e2-9693-b5d5a333289d</entry>
Aug 16 06:25:33 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:25:33 user nova-compute[74681]:     </system>
Aug 16 06:25:33 user nova-compute[74681]:   </sysinfo>
Aug 16 06:25:33 user nova-compute[74681]:   <os>
Aug 16 06:25:33 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:25:33 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:25:33 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:25:33 user nova-compute[74681]:   </os>
Aug 16 06:25:33 user nova-compute[74681]:   <features>
Aug 16 06:25:33 user nova-compute[74681]:     <acpi/>
Aug 16 06:25:33 user nova-compute[74681]:     <apic/>
Aug 16 06:25:33 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:25:33 user nova-compute[74681]:   </features>
Aug 16 06:25:33 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:25:33 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:25:33 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:25:33 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:25:33 user nova-compute[74681]:   </clock>
Aug 16 06:25:33 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:25:33 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:25:33 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:25:33 user nova-compute[74681]:   </cpu>
Aug 16 06:25:33 user nova-compute[74681]:   <devices>
Aug 16 06:25:33 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:25:33 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:25:33 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk"/>
Aug 16 06:25:33 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:25:33 user nova-compute[74681]:     </disk>
Aug 16 06:25:33 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:25:33 user nova-compute[74681]:       <mac address="fa:16:3e:99:5d:4a"/>
Aug 16 06:25:33 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:25:33 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:25:33 user nova-compute[74681]:       <target dev="tapf76ff58a-b1"/>
Aug 16 06:25:33 user nova-compute[74681]:     </interface>
Aug 16 06:25:33 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:25:33 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/console.log" append="off"/>
Aug 16 06:25:33 user nova-compute[74681]:     </serial>
Aug 16 06:25:33 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:25:33 user nova-compute[74681]:     <video>
Aug 16 06:25:33 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:25:33 user nova-compute[74681]:     </video>
Aug 16 06:25:33 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:25:33 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:25:33 user nova-compute[74681]:     </rng>
Aug 16 06:25:33 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:25:33 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:25:33 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:25:33 user nova-compute[74681]:     </memballoon>
Aug 16 06:25:33 user nova-compute[74681]:   </devices>
Aug 16 06:25:33 user nova-compute[74681]: </domain>
Aug 16 06:25:33 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2047769346',display_name='tempest-VolumesSnapshotTestJSON-instance-2047769346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2047769346',id=37,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD314Khrzr+lhybFGQApnSELtS9qoWvnJgGJktl5XgTnlwY2ZhmltZbxFpI+MH8X4Ptj1oh5yB5nU79b2bQ0lRRXX77QZKEDci7cpitr0kqEopcvG/VAbzBHBi0xX1HtVA==',key_name='tempest-keypair-2022894617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01ba755546fe440591b1292c5d74a8f2',ramdisk_id='',reservation_id='r-do7qt8dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-848952719',owner_user_name='tempest-VolumesSnapshotTestJSON-848952719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:25:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='586e737fe78c4bf180d51f0470bd8648',uuid=6370394e-c0c1-40e2-9693-b5d5a333289d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converting VIF {"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:5d:4a,bridge_name='br-int',has_traffic_filtering=True,id=f76ff58a-b1fe-472b-a4d4-92b2ca009d8a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76ff58a-b1') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG os_vif [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:5d:4a,bridge_name='br-int',has_traffic_filtering=True,id=f76ff58a-b1fe-472b-a4d4-92b2ca009d8a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76ff58a-b1') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf76ff58a-b1, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf76ff58a-b1, col_values=(('external_ids', {'iface-id': 'f76ff58a-b1fe-472b-a4d4-92b2ca009d8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:5d:4a', 'vm-uuid': '6370394e-c0c1-40e2-9693-b5d5a333289d'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:33 user nova-compute[74681]: INFO os_vif [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:5d:4a,bridge_name='br-int',has_traffic_filtering=True,id=f76ff58a-b1fe-472b-a4d4-92b2ca009d8a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76ff58a-b1')
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:25:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No VIF found with MAC fa:16:3e:99:5d:4a, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:25:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-ef284ed7-3f19-4d24-9ca5-8aea244cbf72 req-6d8454d3-0ec2-45e0-872c-a69343b42488 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Updated VIF entry in instance network info cache for port f76ff58a-b1fe-472b-a4d4-92b2ca009d8a. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:25:34 user nova-compute[74681]: DEBUG nova.network.neutron [req-ef284ed7-3f19-4d24-9ca5-8aea244cbf72 req-6d8454d3-0ec2-45e0-872c-a69343b42488 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Updating instance_info_cache with network_info: [{"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:25:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ef284ed7-3f19-4d24-9ca5-8aea244cbf72 req-6d8454d3-0ec2-45e0-872c-a69343b42488 service nova] Releasing lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-8a006cae-92a5-443e-ba6f-1e5684ff2453 req-a33a1972-00b6-415d-a932-c5150e2fa63c service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received event network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8a006cae-92a5-443e-ba6f-1e5684ff2453 req-a33a1972-00b6-415d-a932-c5150e2fa63c service nova] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8a006cae-92a5-443e-ba6f-1e5684ff2453 req-a33a1972-00b6-415d-a932-c5150e2fa63c service nova] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8a006cae-92a5-443e-ba6f-1e5684ff2453 req-a33a1972-00b6-415d-a932-c5150e2fa63c service nova] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-8a006cae-92a5-443e-ba6f-1e5684ff2453 req-a33a1972-00b6-415d-a932-c5150e2fa63c service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] No waiting events found dispatching network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:35 user nova-compute[74681]: WARNING nova.compute.manager [req-8a006cae-92a5-443e-ba6f-1e5684ff2453 req-a33a1972-00b6-415d-a932-c5150e2fa63c service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received unexpected event network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a for instance with vm_state building and task_state spawning.
Aug 16 06:25:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-748c74f4-52b6-4baf-baf4-ef0313b38265 req-acf877c6-9966-432c-a935-e2ee1ff468d1 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received event network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-748c74f4-52b6-4baf-baf4-ef0313b38265 req-acf877c6-9966-432c-a935-e2ee1ff468d1 service nova] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-748c74f4-52b6-4baf-baf4-ef0313b38265 req-acf877c6-9966-432c-a935-e2ee1ff468d1 service nova] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-748c74f4-52b6-4baf-baf4-ef0313b38265 req-acf877c6-9966-432c-a935-e2ee1ff468d1 service nova] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-748c74f4-52b6-4baf-baf4-ef0313b38265 req-acf877c6-9966-432c-a935-e2ee1ff468d1 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] No waiting events found dispatching network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:37 user nova-compute[74681]: WARNING nova.compute.manager [req-748c74f4-52b6-4baf-baf4-ef0313b38265 req-acf877c6-9966-432c-a935-e2ee1ff468d1 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received unexpected event network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a for instance with vm_state building and task_state spawning.
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167137.6328003, 6370394e-c0c1-40e2-9693-b5d5a333289d => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:25:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] VM Resumed (Lifecycle Event)
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:25:37 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Instance spawned successfully.
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:25:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167137.6353137, 6370394e-c0c1-40e2-9693-b5d5a333289d => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:25:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] VM Started (Lifecycle Event)
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:25:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:25:37 user nova-compute[74681]: INFO nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 16 06:25:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:37 user nova-compute[74681]: INFO nova.compute.manager [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Took 7.06 seconds to build instance.
Aug 16 06:25:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-fd7173ac-3111-4255-aef8-18226e38c2b0 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.177s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:38 user nova-compute[74681]: INFO nova.compute.manager [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Detaching volume 4d096acd-4110-412e-93db-fa838b40e9ab
Aug 16 06:25:38 user nova-compute[74681]: INFO nova.virt.block_device [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Attempting to driver detach volume 4d096acd-4110-412e-93db-fa838b40e9ab from mountpoint /dev/vdb
Aug 16 06:25:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Attempting to detach device vdb from instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:25:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:25:38 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:25:38 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:25:38 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:25:38 user nova-compute[74681]:   <serial>4d096acd-4110-412e-93db-fa838b40e9ab</serial>
Aug 16 06:25:38 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 06:25:38 user nova-compute[74681]: </disk>
Aug 16 06:25:38 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:25:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully detached device vdb from instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a from the persistent domain config.
Aug 16 06:25:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:25:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:25:38 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:25:38 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:25:38 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:25:38 user nova-compute[74681]:   <serial>4d096acd-4110-412e-93db-fa838b40e9ab</serial>
Aug 16 06:25:38 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 06:25:38 user nova-compute[74681]: </disk>
Aug 16 06:25:38 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167139.3670745, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:25:39 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully detached device vdb from instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a from the live domain config.
Aug 16 06:25:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsTVWxkZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:25:39 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127e870-9221-4cdb-842a-cec53102db71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c55a97c-2c69-47d0-977e-cd2f6fa0b680]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:25:39 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:25:39 user nova-compute[74681]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)
Aug 16 06:25:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:25:39 user nova-compute[74681]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab (non-flash)
Aug 16 06:25:39 user nova-compute[74681]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)
Aug 16 06:25:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948461b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[40850b6e-9498-4fab-9393-dd3933f53eca]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.042s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c88ed-2797-405a-a6bf-e06fa0a3b790]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4599a9-ffa0-43a0-ac87-a54a0628ddf7]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[91487171-195f-4daa-9a12-1a579f99d01f]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6dd366-4124-40ed-917a-242d4aa71022]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2af1b0-17b1-4a52-afcf-9c38c75defb1]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260]
Aug 16 06:25:39 user nova-compute[74681]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab, portal: 172.16.0.220,3260] successful.
Aug 16 06:25:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d096acd-4110-412e-93db-fa838b40e9ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea48d417-5b49-4b95-aa4d-acc0a0fc20e9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== disconnect_volume: return (395ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:25:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:25:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:43 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updating instance_info_cache with network_info: [{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:45 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:25:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue --force-share --output=json" returned: 0 in 0.289s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG nova.objects.instance [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-76f3c78e-cb24-4455-945d-f282286aaae0 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.958s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-546c19b4-21ab-4ecd-86d4-a6e5d0ee7beb tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-546c19b4-21ab-4ecd-86d4-a6e5d0ee7beb tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-546c19b4-21ab-4ecd-86d4-a6e5d0ee7beb tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-546c19b4-21ab-4ecd-86d4-a6e5d0ee7beb tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74681) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG nova.objects.instance [None req-546c19b4-21ab-4ecd-86d4-a6e5d0ee7beb tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:25:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:25:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-023c8251-2005-4ac9-9294-5a2d12640164 req-9d8d8cae-c9c4-4102-961a-97835342d1f4 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-023c8251-2005-4ac9-9294-5a2d12640164 req-9d8d8cae-c9c4-4102-961a-97835342d1f4 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-023c8251-2005-4ac9-9294-5a2d12640164 req-9d8d8cae-c9c4-4102-961a-97835342d1f4 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-023c8251-2005-4ac9-9294-5a2d12640164 req-9d8d8cae-c9c4-4102-961a-97835342d1f4 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-023c8251-2005-4ac9-9294-5a2d12640164 req-9d8d8cae-c9c4-4102-961a-97835342d1f4 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:50 user nova-compute[74681]: WARNING nova.compute.manager [req-023c8251-2005-4ac9-9294-5a2d12640164 req-9d8d8cae-c9c4-4102-961a-97835342d1f4 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state active and task_state powering-off.
Aug 16 06:25:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:25:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7113MB free_disk=25.117900848388672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance destroyed successfully.
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-546c19b4-21ab-4ecd-86d4-a6e5d0ee7beb tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-546c19b4-21ab-4ecd-86d4-a6e5d0ee7beb tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.461s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a95646fe-8d93-47c7-9590-dbbb54c479d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance c119ab6d-f522-4c1c-ad31-c2f569482363 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6370394e-c0c1-40e2-9693-b5d5a333289d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing inventories for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating ProviderTree inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing aggregate associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, aggregates: None {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing trait associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 06:25:51 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.989s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] There are 1 instances to clean {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance has had 2 of 5 cleanup attempts {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11142}}
Aug 16 06:25:52 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Deletion of /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize failed
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-0186b64d-31d7-4b21-ba89-800e8e103dca req-fc89af2d-47f5-413b-b5ca-a8d90e537ea1 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0186b64d-31d7-4b21-ba89-800e8e103dca req-fc89af2d-47f5-413b-b5ca-a8d90e537ea1 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0186b64d-31d7-4b21-ba89-800e8e103dca req-fc89af2d-47f5-413b-b5ca-a8d90e537ea1 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0186b64d-31d7-4b21-ba89-800e8e103dca req-fc89af2d-47f5-413b-b5ca-a8d90e537ea1 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:52 user nova-compute[74681]: DEBUG nova.compute.manager [req-0186b64d-31d7-4b21-ba89-800e8e103dca req-fc89af2d-47f5-413b-b5ca-a8d90e537ea1 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:52 user nova-compute[74681]: WARNING nova.compute.manager [req-0186b64d-31d7-4b21-ba89-800e8e103dca req-fc89af2d-47f5-413b-b5ca-a8d90e537ea1 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state stopped and task_state None.
Aug 16 06:25:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:57 user nova-compute[74681]: INFO nova.compute.manager [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Terminating instance
Aug 16 06:25:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-64cec11c-f28e-479a-ad06-57c81fbfa771 req-f11474f8-346b-4b28-a9e2-0ef0ae44649d service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-changed-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-64cec11c-f28e-479a-ad06-57c81fbfa771 req-f11474f8-346b-4b28-a9e2-0ef0ae44649d service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Refreshing instance network info cache due to event network-changed-b97e373d-1e74-46db-b24a-be1e723bd5ae. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-64cec11c-f28e-479a-ad06-57c81fbfa771 req-f11474f8-346b-4b28-a9e2-0ef0ae44649d service nova] Acquiring lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-64cec11c-f28e-479a-ad06-57c81fbfa771 req-f11474f8-346b-4b28-a9e2-0ef0ae44649d service nova] Acquired lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG nova.network.neutron [req-64cec11c-f28e-479a-ad06-57c81fbfa771 req-f11474f8-346b-4b28-a9e2-0ef0ae44649d service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Refreshing network info cache for port b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-fbfbac07-6ff7-40e6-abd7-a5684f427f50 req-3a141368-124a-498c-abe2-8bf2daae1a96 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-vif-unplugged-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fbfbac07-6ff7-40e6-abd7-a5684f427f50 req-3a141368-124a-498c-abe2-8bf2daae1a96 service nova] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fbfbac07-6ff7-40e6-abd7-a5684f427f50 req-3a141368-124a-498c-abe2-8bf2daae1a96 service nova] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fbfbac07-6ff7-40e6-abd7-a5684f427f50 req-3a141368-124a-498c-abe2-8bf2daae1a96 service nova] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-fbfbac07-6ff7-40e6-abd7-a5684f427f50 req-3a141368-124a-498c-abe2-8bf2daae1a96 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] No waiting events found dispatching network-vif-unplugged-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-fbfbac07-6ff7-40e6-abd7-a5684f427f50 req-3a141368-124a-498c-abe2-8bf2daae1a96 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-vif-unplugged-b97e373d-1e74-46db-b24a-be1e723bd5ae for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:58 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Instance destroyed successfully.
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.objects.instance [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lazy-loading 'resources' on Instance uuid a95646fe-8d93-47c7-9590-dbbb54c479d2 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:18:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1692536432',display_name='tempest-TestStampPattern-server-1692536432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1692536432',id=24,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzoECm225ySl+HyAlmG0sv7wKoEPsgT9yAcs4kwnRa7sd0iBSZuzh0d16UZNUGe8zI0GmoGVsQ+b0UCPKJRw9yS1GVP40Wte/bTkaY2V6aoCUjPKx00k6FD7VMDRaRk9A==',key_name='tempest-TestStampPattern-1999912138',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:18:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57f8c98f4c524a85bfca647755fd7d58',ramdisk_id='',reservation_id='r-26fjpj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-699262125',owner_user_name='tempest-TestStampPattern-699262125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:21:37Z,user_data=None,user_id='2525cd466cfb4097b91557bc3f41313a',uuid=a95646fe-8d93-47c7-9590-dbbb54c479d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converting VIF {"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:f3:59,bridge_name='br-int',has_traffic_filtering=True,id=b97e373d-1e74-46db-b24a-be1e723bd5ae,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e373d-1e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG os_vif [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:f3:59,bridge_name='br-int',has_traffic_filtering=True,id=b97e373d-1e74-46db-b24a-be1e723bd5ae,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e373d-1e') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb97e373d-1e, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:25:58 user nova-compute[74681]: INFO os_vif [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:f3:59,bridge_name='br-int',has_traffic_filtering=True,id=b97e373d-1e74-46db-b24a-be1e723bd5ae,network=Network(b1f91622-fdfd-4e56-a04f-5d3760ec18e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97e373d-1e')
Aug 16 06:25:58 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Deleting instance files /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2_del
Aug 16 06:25:58 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Deletion of /opt/stack/data/nova/instances/a95646fe-8d93-47c7-9590-dbbb54c479d2_del complete
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.network.neutron [req-64cec11c-f28e-479a-ad06-57c81fbfa771 req-f11474f8-346b-4b28-a9e2-0ef0ae44649d service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updated VIF entry in instance network info cache for port b97e373d-1e74-46db-b24a-be1e723bd5ae. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.network.neutron [req-64cec11c-f28e-479a-ad06-57c81fbfa771 req-f11474f8-346b-4b28-a9e2-0ef0ae44649d service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updating instance_info_cache with network_info: [{"id": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "address": "fa:16:3e:ec:f3:59", "network": {"id": "b1f91622-fdfd-4e56-a04f-5d3760ec18e2", "bridge": "br-int", "label": "tempest-TestStampPattern-270056502-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57f8c98f4c524a85bfca647755fd7d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97e373d-1e", "ovs_interfaceid": "b97e373d-1e74-46db-b24a-be1e723bd5ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-64cec11c-f28e-479a-ad06-57c81fbfa771 req-f11474f8-346b-4b28-a9e2-0ef0ae44649d service nova] Releasing lock "refresh_cache-a95646fe-8d93-47c7-9590-dbbb54c479d2" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:25:58 user nova-compute[74681]: INFO nova.compute.manager [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 06:25:58 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:25:58 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:25:59 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:25:59 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Took 0.70 seconds to deallocate network for instance.
Aug 16 06:25:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-146b69af-9035-4701-9109-b695a4cfc6e1 req-3c819f98-b460-4936-b46e-3038aa3cf675 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-vif-deleted-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:25:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:25:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:25:59 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:25:59 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:25:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:25:59 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Deleted allocations for instance a95646fe-8d93-47c7-9590-dbbb54c479d2
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-63ef7cee-ab64-468d-aa58-b433219fbd1a tempest-TestStampPattern-699262125 tempest-TestStampPattern-699262125-project-member] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.224s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "c119ab6d-f522-4c1c-ad31-c2f569482363" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:00 user nova-compute[74681]: INFO nova.compute.manager [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Terminating instance
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74681) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-ec8b57cd-524f-4fd9-b6d6-07833a2397d9 req-1f9ad4f4-0061-48fb-ba71-9052c6688115 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received event network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ec8b57cd-524f-4fd9-b6d6-07833a2397d9 req-1f9ad4f4-0061-48fb-ba71-9052c6688115 service nova] Acquiring lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ec8b57cd-524f-4fd9-b6d6-07833a2397d9 req-1f9ad4f4-0061-48fb-ba71-9052c6688115 service nova] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ec8b57cd-524f-4fd9-b6d6-07833a2397d9 req-1f9ad4f4-0061-48fb-ba71-9052c6688115 service nova] Lock "a95646fe-8d93-47c7-9590-dbbb54c479d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-ec8b57cd-524f-4fd9-b6d6-07833a2397d9 req-1f9ad4f4-0061-48fb-ba71-9052c6688115 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] No waiting events found dispatching network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:26:00 user nova-compute[74681]: WARNING nova.compute.manager [req-ec8b57cd-524f-4fd9-b6d6-07833a2397d9 req-1f9ad4f4-0061-48fb-ba71-9052c6688115 service nova] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Received unexpected event network-vif-plugged-b97e373d-1e74-46db-b24a-be1e723bd5ae for instance with vm_state deleted and task_state None.
Aug 16 06:26:00 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Instance destroyed successfully.
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.objects.instance [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'resources' on Instance uuid c119ab6d-f522-4c1c-ad31-c2f569482363 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1439611529',display_name='tempest-TestVolumeBootPattern-server-1439611529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1439611529',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:24:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-wldggh86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:24:31Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=c119ab6d-f522-4c1c-ad31-c2f569482363,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "address": "fa:16:3e:51:85:34", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb1e46c-81", "ovs_interfaceid": "5bb1e46c-8121-4a0b-bac7-dd198e4952fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5bb1e46c-8121-4a0b-bac7-dd198e4952fd,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb1e46c-81') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_vif [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5bb1e46c-8121-4a0b-bac7-dd198e4952fd,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb1e46c-81') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bb1e46c-81, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:00 user nova-compute[74681]: INFO os_vif [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:85:34,bridge_name='br-int',has_traffic_filtering=True,id=5bb1e46c-8121-4a0b-bac7-dd198e4952fd,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb1e46c-81')
Aug 16 06:26:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYGHuLRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:26:00 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b78c0b-6a4e-4079-ab58-0ce8bf544fb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f09a127-bae2-4d26-8f87-909b20e38e58]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:00 user nova-compute[74681]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)
Aug 16 06:26:00 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:00 user nova-compute[74681]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 (non-flash)
Aug 16 06:26:00 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94606815a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952'): ({'sde'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Removing single pathed devices sde {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb228d-be02-4347-84d7-b39788b757b1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[af15ef12-fc7d-43f5-b8b8-0599ce849e84]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flushing IO for device /dev/sde {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc060a-27f9-4064-80f7-4cf3940b3def]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e14f19-a50f-4f5d-9044-33e8d963e151]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23737633938373434', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4be47e3c', '/dev/disk/by-id/scsi-1SCST_BIO4be47e3c-77c9874420aa6037') {{(pid=121298) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdddbe9-a569-4a91-997a-9461eabc841f]: (4, None) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[161018c8-f111-4a3b-9c63-7333e7212922]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a331e30e-1c58-4b2a-b5f7-76107ba3f12c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952, portal: 172.16.0.220,3260]
Aug 16 06:26:01 user nova-compute[74681]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952, portal: 172.16.0.220,3260] successful.
Aug 16 06:26:01 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e38dc11-e231-46d0-860b-470b2a378952 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca2561-5b6e-4916-81a9-0db94b151507]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== disconnect_volume: return (324ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:26:01 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Deleting instance files /opt/stack/data/nova/instances/c119ab6d-f522-4c1c-ad31-c2f569482363_del
Aug 16 06:26:01 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Deletion of /opt/stack/data/nova/instances/c119ab6d-f522-4c1c-ad31-c2f569482363_del complete
Aug 16 06:26:01 user nova-compute[74681]: INFO nova.compute.manager [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 16 06:26:01 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:26:01 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Took 0.59 seconds to deallocate network for instance.
Aug 16 06:26:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-9d1fe86a-2aaa-446c-abee-0ec84a73e001 req-5920c991-b274-4d87-be2a-3a24cbcdfab1 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received event network-vif-deleted-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:01 user nova-compute[74681]: INFO nova.compute.manager [req-9d1fe86a-2aaa-446c-abee-0ec84a73e001 req-5920c991-b274-4d87-be2a-3a24cbcdfab1 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Neutron deleted interface 5bb1e46c-8121-4a0b-bac7-dd198e4952fd; detaching it from the instance and deleting it from the info cache
Aug 16 06:26:01 user nova-compute[74681]: DEBUG nova.network.neutron [req-9d1fe86a-2aaa-446c-abee-0ec84a73e001 req-5920c991-b274-4d87-be2a-3a24cbcdfab1 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:26:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-9d1fe86a-2aaa-446c-abee-0ec84a73e001 req-5920c991-b274-4d87-be2a-3a24cbcdfab1 service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Detach interface failed, port_id=5bb1e46c-8121-4a0b-bac7-dd198e4952fd, reason: Instance c119ab6d-f522-4c1c-ad31-c2f569482363 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received event network-vif-unplugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] Acquiring lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] No waiting events found dispatching network-vif-unplugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received event network-vif-unplugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received event network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] Acquiring lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] No waiting events found dispatching network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:26:02 user nova-compute[74681]: WARNING nova.compute.manager [req-8f6f766c-eeb2-4be3-961c-5aeef6b79e29 req-8482eb1a-aadb-4997-afa9-b3bd16a528ac service nova] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Received unexpected event network-vif-plugged-5bb1e46c-8121-4a0b-bac7-dd198e4952fd for instance with vm_state active and task_state deleting.
Aug 16 06:26:05 user nova-compute[74681]: INFO nova.compute.manager [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Took 3.64 seconds to detach 1 volumes for instance.
Aug 16 06:26:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Deleting volume: 9e38dc11-e231-46d0-860b-470b2a378952 {{(pid=74681) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 06:26:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:05 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:26:06 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:26:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:06 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167150.583894, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:26:06 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Stopped (Lifecycle Event)
Aug 16 06:26:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7ad3d416-4d42-461c-822e-78f1a0a8bf57 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:26:06 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Deleted allocations for instance c119ab6d-f522-4c1c-ad31-c2f569482363
Aug 16 06:26:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7ad3d416-4d42-461c-822e-78f1a0a8bf57 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:26:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-894edc39-e7ed-4319-9c55-e3f2d2e83412 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "c119ab6d-f522-4c1c-ad31-c2f569482363" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.111s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:13 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167158.604747, a95646fe-8d93-47c7-9590-dbbb54c479d2 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:26:13 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] VM Stopped (Lifecycle Event)
Aug 16 06:26:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-6a8f970b-8b1a-4c3e-8d14-6d3fac8e78a1 None None] [instance: a95646fe-8d93-47c7-9590-dbbb54c479d2] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:26:15 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167160.8388982, c119ab6d-f522-4c1c-ad31-c2f569482363 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:26:15 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] VM Stopped (Lifecycle Event)
Aug 16 06:26:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-12d93245-18e9-4902-b69b-57b0f1ad715a None None] [instance: c119ab6d-f522-4c1c-ad31-c2f569482363] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:26:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 31137824-5fa9-44e3-86ca-5d0587c28454 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 6370394e-c0c1-40e2-9693-b5d5a333289d {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "5e675215-481e-4a14-955a-d92d43671e1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "31137824-5fa9-44e3-86ca-5d0587c28454" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "b581cf93-c19c-4d1f-a000-113a548ee755" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "5e675215-481e-4a14-955a-d92d43671e1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "31137824-5fa9-44e3-86ca-5d0587c28454" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "b581cf93-c19c-4d1f-a000-113a548ee755" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:26:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:26:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:26:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:26:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-32ec199b-f650-4de5-a596-acd111aea649 req-ff5a216b-72bb-4275-b460-a8b9dff94c05 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-changed-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-32ec199b-f650-4de5-a596-acd111aea649 req-ff5a216b-72bb-4275-b460-a8b9dff94c05 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Refreshing instance network info cache due to event network-changed-97185598-923f-4338-a826-e8f18738d20e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-32ec199b-f650-4de5-a596-acd111aea649 req-ff5a216b-72bb-4275-b460-a8b9dff94c05 service nova] Acquiring lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-32ec199b-f650-4de5-a596-acd111aea649 req-ff5a216b-72bb-4275-b460-a8b9dff94c05 service nova] Acquired lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG nova.network.neutron [req-32ec199b-f650-4de5-a596-acd111aea649 req-ff5a216b-72bb-4275-b460-a8b9dff94c05 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Refreshing network info cache for port 97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'flavor' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:30 user nova-compute[74681]: INFO nova.compute.manager [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Attaching volume f500c7ec-57df-4365-bb11-4651c2ea2f3e to /dev/vdb
Aug 16 06:26:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-32ec199b-f650-4de5-a596-acd111aea649 req-ff5a216b-72bb-4275-b460-a8b9dff94c05 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updated VIF entry in instance network info cache for port 97185598-923f-4338-a826-e8f18738d20e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-32ec199b-f650-4de5-a596-acd111aea649 req-ff5a216b-72bb-4275-b460-a8b9dff94c05 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating instance_info_cache with network_info: [{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG os_brick.utils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-32ec199b-f650-4de5-a596-acd111aea649 req-ff5a216b-72bb-4275-b460-a8b9dff94c05 service nova] Releasing lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2c5c71-149c-45ac-817d-3136bdf904d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9174e3-8c07-4a76-805e-f43a63eed835]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5706295-7afb-4649-8de0-1429cce4f0cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1cc2ee-1f33-4f09-90be-db24e08e6beb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:26:31 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:26:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4a134e-375b-4106-9406-93f2da47c5f6]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG os_brick.utils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating existing volume attachment record: 3efff3db-73a3-4b31-b8df-e2f1147afd33 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:26:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:26:38 user nova-compute[74681]: INFO nova.compute.claims [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Claim successful on node user
Aug 16 06:26:38 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.868s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG nova.network.neutron [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:26:39 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:26:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG nova.policy [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '790c60ee58a549ddaabd5f0badcb77fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845526507c1a4a9eadc6c45271cceb94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:26:39 user nova-compute[74681]: INFO nova.virt.block_device [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Booting with volume 665615ea-05d5-4978-b77e-5d3712fb916a at /dev/vda
Aug 16 06:26:39 user nova-compute[74681]: DEBUG os_brick.utils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f742d970-a55b-46eb-9c5c-02c2f253ec95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a7dae1-f0d4-451a-9330-a73e29094036]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fbb15e-0242-4771-b82e-803e3e8fc8a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d61a2e-c092-48df-b50b-1e7edb678383]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:26:39 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:26:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[21377c02-67dc-4b77-9f78-eafade1aca7d]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG os_brick.utils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating existing volume attachment record: 5bd28c49-3533-41ff-aa72-8b951302fa4b {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:39 user nova-compute[74681]: DEBUG nova.network.neutron [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Successfully created port: 19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkKmGnAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:26:40 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:26:40 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:26:40 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c05320-177a-4997-a1ad-442fee97dee2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:26:40 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c0293-31c5-4353-97bd-5e242b09e1fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e] added
Aug 16 06:26:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae8cad4-ac5b-4dbd-8343-64349e3b1eeb]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb34ca8e-1f8b-474b-9185-7bf8643ad5f6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkKmGnAL {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkKmGnAL" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cb632a-2078-4ae9-aac2-a819967baa74]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qkKmGnAL'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3ad96e-f59f-4065-b7eb-96c33190afd8]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa15e35-ca9d-456d-9a00-fa67f2486293]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG nova.network.neutron [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Successfully updated port: 19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquired lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG nova.network.neutron [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-fc317ac8-53be-4994-b570-6ce5348d93d9 req-eb61d565-ec65-444f-8b4b-e780d39ff660 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-changed-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG nova.compute.manager [req-fc317ac8-53be-4994-b570-6ce5348d93d9 req-eb61d565-ec65-444f-8b4b-e780d39ff660 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Refreshing instance network info cache due to event network-changed-19c41113-5a63-4592-ac7b-88104f472bab. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fc317ac8-53be-4994-b570-6ce5348d93d9 req-eb61d565-ec65-444f-8b4b-e780d39ff660 service nova] Acquiring lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d84c742-8e36-4789-847b-de60b4fdf119]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e, portal: 172.16.0.220,3260]
Aug 16 06:26:40 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e, portal: 172.16.0.220,3260] successful.
Aug 16 06:26:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[16014d11-4527-4862-a17e-4ea00c0ec61b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG nova.network.neutron [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2eb014-9b8d-46be-a7f9-546221f7bd40]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:40 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:26:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:40 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:26:40 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[043be141-b4fe-4259-8486-bb13d0488c65]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:26:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating instance_info_cache with network_info: [{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Releasing lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance network_info: |[{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fc317ac8-53be-4994-b570-6ce5348d93d9 req-eb61d565-ec65-444f-8b4b-e780d39ff660 service nova] Acquired lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG nova.network.neutron [req-fc317ac8-53be-4994-b570-6ce5348d93d9 req-eb61d565-ec65-444f-8b4b-e780d39ff660 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Refreshing network info cache for port 19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG nova.network.neutron [req-fc317ac8-53be-4994-b570-6ce5348d93d9 req-eb61d565-ec65-444f-8b4b-e780d39ff660 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updated VIF entry in instance network info cache for port 19c41113-5a63-4592-ac7b-88104f472bab. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG nova.network.neutron [req-fc317ac8-53be-4994-b570-6ce5348d93d9 req-eb61d565-ec65-444f-8b4b-e780d39ff660 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating instance_info_cache with network_info: [{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fc317ac8-53be-4994-b570-6ce5348d93d9 req-eb61d565-ec65-444f-8b4b-e780d39ff660 service nova] Releasing lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkKmGnAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26466613533343765', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466613533343765', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'flavor' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:26:41 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:26:41 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:26:41 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:26:41 user nova-compute[74681]:   <serial>f500c7ec-57df-4365-bb11-4651c2ea2f3e</serial>
Aug 16 06:26:41 user nova-compute[74681]: </disk>
Aug 16 06:26:41 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:26:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:26:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:26:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No VIF found with MAC fa:16:3e:de:45:74, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:26:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ecaefe70-5704-4fa0-be07-4657ac5d710b tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.700s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:43 user nova-compute[74681]: INFO nova.compute.manager [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Rescuing
Aug 16 06:26:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:26:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquired lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:26:43 user nova-compute[74681]: DEBUG nova.network.neutron [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG nova.network.neutron [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating instance_info_cache with network_info: [{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Releasing lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-e355b334-03a4-40be-a959-38c44d4dc362 req-02729991-8cdd-4bbe-a489-9986f4435758 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e355b334-03a4-40be-a959-38c44d4dc362 req-02729991-8cdd-4bbe-a489-9986f4435758 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e355b334-03a4-40be-a959-38c44d4dc362 req-02729991-8cdd-4bbe-a489-9986f4435758 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e355b334-03a4-40be-a959-38c44d4dc362 req-02729991-8cdd-4bbe-a489-9986f4435758 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-e355b334-03a4-40be-a959-38c44d4dc362 req-02729991-8cdd-4bbe-a489-9986f4435758 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:26:44 user nova-compute[74681]: WARNING nova.compute.manager [req-e355b334-03a4-40be-a959-38c44d4dc362 req-02729991-8cdd-4bbe-a489-9986f4435758 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state active and task_state rescuing.
Aug 16 06:26:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance destroyed successfully.
Aug 16 06:26:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Attempting rescue
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74681) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance directory exists: not creating {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 06:26:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Creating image(s)
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue" returned: 0 in 0.054s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'migration_context' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Start _get_guest_xml network_info=[{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:de:45:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'resources' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'numa_topology' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:26:45 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1769746501',display_name='tempest-ServerRescueNegativeTestJSON-server-1769746501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1769746501',id=36,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmSo2KxM/KHqSgb3nfjTsKj9pM2kypAKT8/4qdwkDsRFDQqm4dy2PdbZHyYKvvnx8kbEFjx7CA5pnD/JVs17SbMvzdgs2hIRpWHeOUKGWZ+FywpX+QxYxzbi/t41klHZQ==',key_name='tempest-keypair-1975514318',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:24:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-la5jnhhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='830eea7441aa4c928dcb598a555e01cd',uuid=7998966b-a074-4d79-bf3f-9c5b9fbc60a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:de:45:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "vif_mac": "fa:16:3e:de:45:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:45:74,bridge_name='br-int',has_traffic_filtering=True,id=97185598-923f-4338-a826-e8f18738d20e,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97185598-92') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'pci_devices' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:26:45 user nova-compute[74681]:   <uuid>7998966b-a074-4d79-bf3f-9c5b9fbc60a9</uuid>
Aug 16 06:26:45 user nova-compute[74681]:   <name>instance-00000024</name>
Aug 16 06:26:45 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:26:45 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:26:45 user nova-compute[74681]:   <metadata>
Aug 16 06:26:45 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:26:45 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:26:45 user nova-compute[74681]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1769746501</nova:name>
Aug 16 06:26:45 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:26:45</nova:creationTime>
Aug 16 06:26:45 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:26:45 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:26:45 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:26:45 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:26:45 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:26:45 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:26:45 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:26:45 user nova-compute[74681]:       <nova:owner>
Aug 16 06:26:45 user nova-compute[74681]:         <nova:user uuid="830eea7441aa4c928dcb598a555e01cd">tempest-ServerRescueNegativeTestJSON-472247401-project-member</nova:user>
Aug 16 06:26:45 user nova-compute[74681]:         <nova:project uuid="ce6d58d07b1145b493d5a07a40c1eb0c">tempest-ServerRescueNegativeTestJSON-472247401</nova:project>
Aug 16 06:26:45 user nova-compute[74681]:       </nova:owner>
Aug 16 06:26:45 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:26:45 user nova-compute[74681]:       <nova:ports>
Aug 16 06:26:45 user nova-compute[74681]:         <nova:port uuid="97185598-923f-4338-a826-e8f18738d20e">
Aug 16 06:26:45 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 06:26:45 user nova-compute[74681]:         </nova:port>
Aug 16 06:26:45 user nova-compute[74681]:       </nova:ports>
Aug 16 06:26:45 user nova-compute[74681]:     </nova:instance>
Aug 16 06:26:45 user nova-compute[74681]:   </metadata>
Aug 16 06:26:45 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:26:45 user nova-compute[74681]:     <system>
Aug 16 06:26:45 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:26:45 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:26:45 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:26:45 user nova-compute[74681]:       <entry name="serial">7998966b-a074-4d79-bf3f-9c5b9fbc60a9</entry>
Aug 16 06:26:45 user nova-compute[74681]:       <entry name="uuid">7998966b-a074-4d79-bf3f-9c5b9fbc60a9</entry>
Aug 16 06:26:45 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:26:45 user nova-compute[74681]:     </system>
Aug 16 06:26:45 user nova-compute[74681]:   </sysinfo>
Aug 16 06:26:45 user nova-compute[74681]:   <os>
Aug 16 06:26:45 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:26:45 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:26:45 user nova-compute[74681]:   </os>
Aug 16 06:26:45 user nova-compute[74681]:   <features>
Aug 16 06:26:45 user nova-compute[74681]:     <acpi/>
Aug 16 06:26:45 user nova-compute[74681]:     <apic/>
Aug 16 06:26:45 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:26:45 user nova-compute[74681]:   </features>
Aug 16 06:26:45 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:26:45 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:26:45 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:26:45 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:26:45 user nova-compute[74681]:   </clock>
Aug 16 06:26:45 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:26:45 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:26:45 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:26:45 user nova-compute[74681]:   </cpu>
Aug 16 06:26:45 user nova-compute[74681]:   <devices>
Aug 16 06:26:45 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:26:45 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:26:45 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue"/>
Aug 16 06:26:45 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:26:45 user nova-compute[74681]:     </disk>
Aug 16 06:26:45 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:26:45 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:26:45 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk"/>
Aug 16 06:26:45 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:26:45 user nova-compute[74681]:     </disk>
Aug 16 06:26:45 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:26:45 user nova-compute[74681]:       <mac address="fa:16:3e:de:45:74"/>
Aug 16 06:26:45 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:26:45 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:26:45 user nova-compute[74681]:       <target dev="tap97185598-92"/>
Aug 16 06:26:45 user nova-compute[74681]:     </interface>
Aug 16 06:26:45 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:26:45 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/console.log" append="off"/>
Aug 16 06:26:45 user nova-compute[74681]:     </serial>
Aug 16 06:26:45 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:26:45 user nova-compute[74681]:     <video>
Aug 16 06:26:45 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:26:45 user nova-compute[74681]:     </video>
Aug 16 06:26:45 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:26:45 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:26:45 user nova-compute[74681]:     </rng>
Aug 16 06:26:45 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:26:45 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:26:45 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:26:45 user nova-compute[74681]:     </memballoon>
Aug 16 06:26:45 user nova-compute[74681]:   </devices>
Aug 16 06:26:45 user nova-compute[74681]: </domain>
Aug 16 06:26:45 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:26:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance destroyed successfully.
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] No VIF found with MAC fa:16:3e:de:45:74, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:26:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-366fec3a-e6ab-4184-b8cb-08fdb9a9ddaf req-a1695487-9dfa-4b26-8a20-a73c8aae5157 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-366fec3a-e6ab-4184-b8cb-08fdb9a9ddaf req-a1695487-9dfa-4b26-8a20-a73c8aae5157 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-366fec3a-e6ab-4184-b8cb-08fdb9a9ddaf req-a1695487-9dfa-4b26-8a20-a73c8aae5157 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-366fec3a-e6ab-4184-b8cb-08fdb9a9ddaf req-a1695487-9dfa-4b26-8a20-a73c8aae5157 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:46 user nova-compute[74681]: DEBUG nova.compute.manager [req-366fec3a-e6ab-4184-b8cb-08fdb9a9ddaf req-a1695487-9dfa-4b26-8a20-a73c8aae5157 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:26:46 user nova-compute[74681]: WARNING nova.compute.manager [req-366fec3a-e6ab-4184-b8cb-08fdb9a9ddaf req-a1695487-9dfa-4b26-8a20-a73c8aae5157 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state active and task_state rescuing.
Aug 16 06:26:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updating instance_info_cache with network_info: [{"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:26:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:26:49 user nova-compute[74681]: WARNING nova.compute.manager [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state active and task_state rescuing.
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:26:49 user nova-compute[74681]: WARNING nova.compute.manager [req-71c56c8c-7b74-48a1-a03b-5f06031a6210 req-221d51d4-185f-41ed-bf63-19fd11fcf819 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state active and task_state rescuing.
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167209.5236924, 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:26:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] VM Resumed (Lifecycle Event)
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e8c6842f-35e8-486f-80da-104974f8406e tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167209.537777, 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:26:49 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] VM Started (Lifecycle Event)
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:52 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:26:52 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=25.20919418334961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6370394e-c0c1-40e2-9693-b5d5a333289d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:26:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:26:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:26:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:26:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Creating image(s)
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Ensure instance console log exists: /opt/stack/data/nova/instances/4cacaa1a-0734-4f8d-9e2a-f138bdd06553/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Start _get_guest_xml network_info=[{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '5bd28c49-3533-41ff-aa72-8b951302fa4b', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwHWlah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4cacaa1a-0734-4f8d-9e2a-f138bdd06553', 'attached_at': '', 'detached_at': '', 'volume_id': '665615ea-05d5-4978-b77e-5d3712fb916a', 'serial': '665615ea-05d5-4978-b77e-5d3712fb916a'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:26:57 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:26:57 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwHWlah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:26:57 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:26:57 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:26:57 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[94de2604-10f2-4950-acc7-f13907307f85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:26:57 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0545d085-282a-4c49-8d81-b2578b2473f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a] added
Aug 16 06:26:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25833ba-e08f-4d91-ab73-d9e828db6ddb]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6364c221-220a-4e8e-a136-aa686e84146e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmwHWlah {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmwHWlah" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5391ab-fdad-43f1-b8dc-057d76de14f2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmwHWlah'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af28379-3acb-4dbf-8053-393a2350431d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f556584-b84f-4c77-9438-e3beab697cf8]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:57 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:26:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:57 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:26:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e87383-76f9-4f21-a8af-0d425a512daa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260]
Aug 16 06:26:57 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260] successful.
Aug 16 06:26:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d85ec2-5b1d-4187-bdf8-50c6e19e8ac8]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d34e41-e39d-4930-9666-52650cb240a4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:57 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:26:57 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:26:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:26:57 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:26:57 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:26:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.045s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95f8dbf-510e-4606-9706-f4cd70835166]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:26:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwHWlah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26531653532646362', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531653532646362', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1241571183',display_name='tempest-ServerActionsTestOtherA-server-1241571183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1241571183',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-5k4khnid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=4cacaa1a-0734-4f8d-9e2a-f138bdd06553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.objects.instance [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:26:58 user nova-compute[74681]:   <uuid>4cacaa1a-0734-4f8d-9e2a-f138bdd06553</uuid>
Aug 16 06:26:58 user nova-compute[74681]:   <name>instance-00000026</name>
Aug 16 06:26:58 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:26:58 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:26:58 user nova-compute[74681]:   <metadata>
Aug 16 06:26:58 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:26:58 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:26:58 user nova-compute[74681]:       <nova:name>tempest-ServerActionsTestOtherA-server-1241571183</nova:name>
Aug 16 06:26:58 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:26:57</nova:creationTime>
Aug 16 06:26:58 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:26:58 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:26:58 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:26:58 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:26:58 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:26:58 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:26:58 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:26:58 user nova-compute[74681]:       <nova:owner>
Aug 16 06:26:58 user nova-compute[74681]:         <nova:user uuid="790c60ee58a549ddaabd5f0badcb77fe">tempest-ServerActionsTestOtherA-2037182259-project-member</nova:user>
Aug 16 06:26:58 user nova-compute[74681]:         <nova:project uuid="845526507c1a4a9eadc6c45271cceb94">tempest-ServerActionsTestOtherA-2037182259</nova:project>
Aug 16 06:26:58 user nova-compute[74681]:       </nova:owner>
Aug 16 06:26:58 user nova-compute[74681]:       <nova:ports>
Aug 16 06:26:58 user nova-compute[74681]:         <nova:port uuid="19c41113-5a63-4592-ac7b-88104f472bab">
Aug 16 06:26:58 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:26:58 user nova-compute[74681]:         </nova:port>
Aug 16 06:26:58 user nova-compute[74681]:       </nova:ports>
Aug 16 06:26:58 user nova-compute[74681]:     </nova:instance>
Aug 16 06:26:58 user nova-compute[74681]:   </metadata>
Aug 16 06:26:58 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:26:58 user nova-compute[74681]:     <system>
Aug 16 06:26:58 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:26:58 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:26:58 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:26:58 user nova-compute[74681]:       <entry name="serial">4cacaa1a-0734-4f8d-9e2a-f138bdd06553</entry>
Aug 16 06:26:58 user nova-compute[74681]:       <entry name="uuid">4cacaa1a-0734-4f8d-9e2a-f138bdd06553</entry>
Aug 16 06:26:58 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:26:58 user nova-compute[74681]:     </system>
Aug 16 06:26:58 user nova-compute[74681]:   </sysinfo>
Aug 16 06:26:58 user nova-compute[74681]:   <os>
Aug 16 06:26:58 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:26:58 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:26:58 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:26:58 user nova-compute[74681]:   </os>
Aug 16 06:26:58 user nova-compute[74681]:   <features>
Aug 16 06:26:58 user nova-compute[74681]:     <acpi/>
Aug 16 06:26:58 user nova-compute[74681]:     <apic/>
Aug 16 06:26:58 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:26:58 user nova-compute[74681]:   </features>
Aug 16 06:26:58 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:26:58 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:26:58 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:26:58 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:26:58 user nova-compute[74681]:   </clock>
Aug 16 06:26:58 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:26:58 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:26:58 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:26:58 user nova-compute[74681]:   </cpu>
Aug 16 06:26:58 user nova-compute[74681]:   <devices>
Aug 16 06:26:58 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:26:58 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:26:58 user nova-compute[74681]:       <source dev="/dev/sdd"/>
Aug 16 06:26:58 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:26:58 user nova-compute[74681]:       <serial>665615ea-05d5-4978-b77e-5d3712fb916a</serial>
Aug 16 06:26:58 user nova-compute[74681]:     </disk>
Aug 16 06:26:58 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:26:58 user nova-compute[74681]:       <mac address="fa:16:3e:80:4b:a4"/>
Aug 16 06:26:58 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:26:58 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:26:58 user nova-compute[74681]:       <target dev="tap19c41113-5a"/>
Aug 16 06:26:58 user nova-compute[74681]:     </interface>
Aug 16 06:26:58 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:26:58 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/4cacaa1a-0734-4f8d-9e2a-f138bdd06553/console.log" append="off"/>
Aug 16 06:26:58 user nova-compute[74681]:     </serial>
Aug 16 06:26:58 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:26:58 user nova-compute[74681]:     <video>
Aug 16 06:26:58 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:26:58 user nova-compute[74681]:     </video>
Aug 16 06:26:58 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:26:58 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:26:58 user nova-compute[74681]:     </rng>
Aug 16 06:26:58 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:26:58 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:26:58 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:26:58 user nova-compute[74681]:     </memballoon>
Aug 16 06:26:58 user nova-compute[74681]:   </devices>
Aug 16 06:26:58 user nova-compute[74681]: </domain>
Aug 16 06:26:58 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1241571183',display_name='tempest-ServerActionsTestOtherA-server-1241571183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1241571183',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-5k4khnid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=4cacaa1a-0734-4f8d-9e2a-f138bdd06553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG os_vif [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19c41113-5a, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19c41113-5a, col_values=(('external_ids', {'iface-id': '19c41113-5a63-4592-ac7b-88104f472bab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:4b:a4', 'vm-uuid': '4cacaa1a-0734-4f8d-9e2a-f138bdd06553'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:26:58 user nova-compute[74681]: INFO os_vif [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a')
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:26:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No VIF found with MAC fa:16:3e:80:4b:a4, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:26:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-48a39f26-66fa-4a87-8e7f-f3a86da6594a req-f4b547f7-e207-479b-ac92-58033b6247e2 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-48a39f26-66fa-4a87-8e7f-f3a86da6594a req-f4b547f7-e207-479b-ac92-58033b6247e2 service nova] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-48a39f26-66fa-4a87-8e7f-f3a86da6594a req-f4b547f7-e207-479b-ac92-58033b6247e2 service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-48a39f26-66fa-4a87-8e7f-f3a86da6594a req-f4b547f7-e207-479b-ac92-58033b6247e2 service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-48a39f26-66fa-4a87-8e7f-f3a86da6594a req-f4b547f7-e207-479b-ac92-58033b6247e2 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] No waiting events found dispatching network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:00 user nova-compute[74681]: WARNING nova.compute.manager [req-48a39f26-66fa-4a87-8e7f-f3a86da6594a req-f4b547f7-e207-479b-ac92-58033b6247e2 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received unexpected event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab for instance with vm_state building and task_state spawning.
Aug 16 06:27:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:27:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:01 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:27:01 user nova-compute[74681]: INFO nova.compute.claims [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Claim successful on node user
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:27:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-f84a87f5-76aa-4502-be11-b7eec1b47b0f req-aa7fb6cb-0fcb-4e33-aacc-8c98b4fb62ec service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f84a87f5-76aa-4502-be11-b7eec1b47b0f req-aa7fb6cb-0fcb-4e33-aacc-8c98b4fb62ec service nova] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f84a87f5-76aa-4502-be11-b7eec1b47b0f req-aa7fb6cb-0fcb-4e33-aacc-8c98b4fb62ec service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f84a87f5-76aa-4502-be11-b7eec1b47b0f req-aa7fb6cb-0fcb-4e33-aacc-8c98b4fb62ec service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-f84a87f5-76aa-4502-be11-b7eec1b47b0f req-aa7fb6cb-0fcb-4e33-aacc-8c98b4fb62ec service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] No waiting events found dispatching network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:02 user nova-compute[74681]: WARNING nova.compute.manager [req-f84a87f5-76aa-4502-be11-b7eec1b47b0f req-aa7fb6cb-0fcb-4e33-aacc-8c98b4fb62ec service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received unexpected event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab for instance with vm_state building and task_state spawning.
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:27:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Creating image(s)
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "/opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "/opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167222.7219763, 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] VM Resumed (Lifecycle Event)
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:27:02 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance spawned successfully.
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.policy [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffd09ff1adb847afae4d0dc786a661e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51e79d8a3ec4a3b877a82b3863c5a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:27:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:27:02 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167222.7235727, 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:02 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] VM Started (Lifecycle Event)
Aug 16 06:27:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:03 user nova-compute[74681]: INFO nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 16 06:27:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:03 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:27:03 user nova-compute[74681]: INFO nova.compute.manager [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Took 25.37 seconds to build instance.
Aug 16 06:27:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-961249c1-e8e9-4b6f-824c-d17918eebdbb tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.493s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d.part --force-share --output=json" returned: 0 in 0.286s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG nova.virt.images [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] b7e981af-6965-4a0f-a22d-19445e4d6bdb was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d.part /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d.part /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d.converted" returned: 0 in 0.260s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d.converted --force-share --output=json" returned: 0 in 0.235s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.392s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Successfully created port: b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d --force-share --output=json" returned: 0 in 0.214s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d,backing_fmt=raw /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d,backing_fmt=raw /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk 1073741824" returned: 0 in 0.197s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.431s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:27:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Cannot resize image /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'migration_context' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Ensure instance console log exists: /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Successfully updated port: b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquired lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-4a2938f6-0cde-4bcd-af08-a130fcbaef12 req-a3161ff8-e0d8-4c20-8f8d-621db59a7fc7 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-4a2938f6-0cde-4bcd-af08-a130fcbaef12 req-a3161ff8-e0d8-4c20-8f8d-621db59a7fc7 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing instance network info cache due to event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4a2938f6-0cde-4bcd-af08-a130fcbaef12 req-a3161ff8-e0d8-4c20-8f8d-621db59a7fc7 service nova] Acquiring lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:27:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating instance_info_cache with network_info: [{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Releasing lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Instance network_info: |[{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4a2938f6-0cde-4bcd-af08-a130fcbaef12 req-a3161ff8-e0d8-4c20-8f8d-621db59a7fc7 service nova] Acquired lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-4a2938f6-0cde-4bcd-af08-a130fcbaef12 req-a3161ff8-e0d8-4c20-8f8d-621db59a7fc7 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Start _get_guest_xml network_info=[{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:26:58Z,direct_url=<?>,disk_format='qcow2',id=b7e981af-6965-4a0f-a22d-19445e4d6bdb,min_disk=0,min_ram=0,name='tempest-scenario-img--1612262685',owner='d51e79d8a3ec4a3b877a82b3863c5a10',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:27:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': 'b7e981af-6965-4a0f-a22d-19445e4d6bdb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:27:06 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:27:06 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:26:58Z,direct_url=<?>,disk_format='qcow2',id=b7e981af-6965-4a0f-a22d-19445e4d6bdb,min_disk=0,min_ram=0,name='tempest-scenario-img--1612262685',owner='d51e79d8a3ec4a3b877a82b3863c5a10',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:27:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1861279471',display_name='tempest-TestMinimumBasicScenario-server-1861279471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1861279471',id=39,image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZyOSjET3GDAIpQC3+ps+9KTk+m6cZvrsP+bZo2Ue/deEESsJytdYN10l+nGGzLIIsfzGIU5bWUT7lqG7VEmzSe/dcAr81t4dxnHCV6jG3DB//xVoOGRHNLu5cH5OdnQ==',key_name='tempest-TestMinimumBasicScenario-1809299411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-3im4rpgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:27:03Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=b8e4f0c3-d421-4612-9ffd-eb882fb72eed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'pci_devices' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:27:06 user nova-compute[74681]:   <uuid>b8e4f0c3-d421-4612-9ffd-eb882fb72eed</uuid>
Aug 16 06:27:06 user nova-compute[74681]:   <name>instance-00000027</name>
Aug 16 06:27:06 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:27:06 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:27:06 user nova-compute[74681]:   <metadata>
Aug 16 06:27:06 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:27:06 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:27:06 user nova-compute[74681]:       <nova:name>tempest-TestMinimumBasicScenario-server-1861279471</nova:name>
Aug 16 06:27:06 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:27:06</nova:creationTime>
Aug 16 06:27:06 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:27:06 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:27:06 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:27:06 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:27:06 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:27:06 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:27:06 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:27:06 user nova-compute[74681]:       <nova:owner>
Aug 16 06:27:06 user nova-compute[74681]:         <nova:user uuid="ffd09ff1adb847afae4d0dc786a661e7">tempest-TestMinimumBasicScenario-1506407050-project-member</nova:user>
Aug 16 06:27:06 user nova-compute[74681]:         <nova:project uuid="d51e79d8a3ec4a3b877a82b3863c5a10">tempest-TestMinimumBasicScenario-1506407050</nova:project>
Aug 16 06:27:06 user nova-compute[74681]:       </nova:owner>
Aug 16 06:27:06 user nova-compute[74681]:       <nova:root type="image" uuid="b7e981af-6965-4a0f-a22d-19445e4d6bdb"/>
Aug 16 06:27:06 user nova-compute[74681]:       <nova:ports>
Aug 16 06:27:06 user nova-compute[74681]:         <nova:port uuid="b76985e8-e864-4b67-acd4-638e9c3c7d78">
Aug 16 06:27:06 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 06:27:06 user nova-compute[74681]:         </nova:port>
Aug 16 06:27:06 user nova-compute[74681]:       </nova:ports>
Aug 16 06:27:06 user nova-compute[74681]:     </nova:instance>
Aug 16 06:27:06 user nova-compute[74681]:   </metadata>
Aug 16 06:27:06 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:27:06 user nova-compute[74681]:     <system>
Aug 16 06:27:06 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:27:06 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:27:06 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:27:06 user nova-compute[74681]:       <entry name="serial">b8e4f0c3-d421-4612-9ffd-eb882fb72eed</entry>
Aug 16 06:27:06 user nova-compute[74681]:       <entry name="uuid">b8e4f0c3-d421-4612-9ffd-eb882fb72eed</entry>
Aug 16 06:27:06 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:27:06 user nova-compute[74681]:     </system>
Aug 16 06:27:06 user nova-compute[74681]:   </sysinfo>
Aug 16 06:27:06 user nova-compute[74681]:   <os>
Aug 16 06:27:06 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:27:06 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:27:06 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:27:06 user nova-compute[74681]:   </os>
Aug 16 06:27:06 user nova-compute[74681]:   <features>
Aug 16 06:27:06 user nova-compute[74681]:     <acpi/>
Aug 16 06:27:06 user nova-compute[74681]:     <apic/>
Aug 16 06:27:06 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:27:06 user nova-compute[74681]:   </features>
Aug 16 06:27:06 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:27:06 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:27:06 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:27:06 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:27:06 user nova-compute[74681]:   </clock>
Aug 16 06:27:06 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:27:06 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:27:06 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:27:06 user nova-compute[74681]:   </cpu>
Aug 16 06:27:06 user nova-compute[74681]:   <devices>
Aug 16 06:27:06 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:27:06 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:27:06 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk"/>
Aug 16 06:27:06 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:27:06 user nova-compute[74681]:     </disk>
Aug 16 06:27:06 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:27:06 user nova-compute[74681]:       <mac address="fa:16:3e:8f:24:33"/>
Aug 16 06:27:06 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:27:06 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:27:06 user nova-compute[74681]:       <target dev="tapb76985e8-e8"/>
Aug 16 06:27:06 user nova-compute[74681]:     </interface>
Aug 16 06:27:06 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:27:06 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/console.log" append="off"/>
Aug 16 06:27:06 user nova-compute[74681]:     </serial>
Aug 16 06:27:06 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:27:06 user nova-compute[74681]:     <video>
Aug 16 06:27:06 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:27:06 user nova-compute[74681]:     </video>
Aug 16 06:27:06 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:27:06 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:27:06 user nova-compute[74681]:     </rng>
Aug 16 06:27:06 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:27:06 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:27:06 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:27:06 user nova-compute[74681]:     </memballoon>
Aug 16 06:27:06 user nova-compute[74681]:   </devices>
Aug 16 06:27:06 user nova-compute[74681]: </domain>
Aug 16 06:27:06 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1861279471',display_name='tempest-TestMinimumBasicScenario-server-1861279471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1861279471',id=39,image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZyOSjET3GDAIpQC3+ps+9KTk+m6cZvrsP+bZo2Ue/deEESsJytdYN10l+nGGzLIIsfzGIU5bWUT7lqG7VEmzSe/dcAr81t4dxnHCV6jG3DB//xVoOGRHNLu5cH5OdnQ==',key_name='tempest-TestMinimumBasicScenario-1809299411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-3im4rpgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:27:03Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=b8e4f0c3-d421-4612-9ffd-eb882fb72eed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG os_vif [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb76985e8-e8, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb76985e8-e8, col_values=(('external_ids', {'iface-id': 'b76985e8-e864-4b67-acd4-638e9c3c7d78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:24:33', 'vm-uuid': 'b8e4f0c3-d421-4612-9ffd-eb882fb72eed'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:06 user nova-compute[74681]: INFO os_vif [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8')
Aug 16 06:27:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No VIF found with MAC fa:16:3e:8f:24:33, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-4a2938f6-0cde-4bcd-af08-a130fcbaef12 req-a3161ff8-e0d8-4c20-8f8d-621db59a7fc7 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updated VIF entry in instance network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-4a2938f6-0cde-4bcd-af08-a130fcbaef12 req-a3161ff8-e0d8-4c20-8f8d-621db59a7fc7 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating instance_info_cache with network_info: [{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:27:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4a2938f6-0cde-4bcd-af08-a130fcbaef12 req-a3161ff8-e0d8-4c20-8f8d-621db59a7fc7 service nova] Releasing lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG nova.compute.manager [req-a71fcfcf-0d41-4540-9c55-0856b3ce801b req-541de6d7-9e97-4686-a8dd-bc41d1243951 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a71fcfcf-0d41-4540-9c55-0856b3ce801b req-541de6d7-9e97-4686-a8dd-bc41d1243951 service nova] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a71fcfcf-0d41-4540-9c55-0856b3ce801b req-541de6d7-9e97-4686-a8dd-bc41d1243951 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a71fcfcf-0d41-4540-9c55-0856b3ce801b req-541de6d7-9e97-4686-a8dd-bc41d1243951 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG nova.compute.manager [req-a71fcfcf-0d41-4540-9c55-0856b3ce801b req-541de6d7-9e97-4686-a8dd-bc41d1243951 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] No waiting events found dispatching network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:08 user nova-compute[74681]: WARNING nova.compute.manager [req-a71fcfcf-0d41-4540-9c55-0856b3ce801b req-541de6d7-9e97-4686-a8dd-bc41d1243951 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received unexpected event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 for instance with vm_state building and task_state spawning.
Aug 16 06:27:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.compute.manager [req-dd83ac83-bc50-4b51-8260-e46fa47c1f6e req-db8cbd4e-4110-46e2-998a-ac6ed857b466 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dd83ac83-bc50-4b51-8260-e46fa47c1f6e req-db8cbd4e-4110-46e2-998a-ac6ed857b466 service nova] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dd83ac83-bc50-4b51-8260-e46fa47c1f6e req-db8cbd4e-4110-46e2-998a-ac6ed857b466 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dd83ac83-bc50-4b51-8260-e46fa47c1f6e req-db8cbd4e-4110-46e2-998a-ac6ed857b466 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.compute.manager [req-dd83ac83-bc50-4b51-8260-e46fa47c1f6e req-db8cbd4e-4110-46e2-998a-ac6ed857b466 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] No waiting events found dispatching network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:10 user nova-compute[74681]: WARNING nova.compute.manager [req-dd83ac83-bc50-4b51-8260-e46fa47c1f6e req-db8cbd4e-4110-46e2-998a-ac6ed857b466 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received unexpected event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 for instance with vm_state building and task_state spawning.
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167230.6096754, b8e4f0c3-d421-4612-9ffd-eb882fb72eed => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:10 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] VM Resumed (Lifecycle Event)
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:27:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Instance spawned successfully.
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:10 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167230.6137261, b8e4f0c3-d421-4612-9ffd-eb882fb72eed => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:10 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] VM Started (Lifecycle Event)
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:10 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:27:10 user nova-compute[74681]: INFO nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Took 8.05 seconds to spawn the instance on the hypervisor.
Aug 16 06:27:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:10 user nova-compute[74681]: INFO nova.compute.manager [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Took 9.20 seconds to build instance.
Aug 16 06:27:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b63e988d-96f2-44c9-9d0b-fac2faab339d tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.360s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:11 user nova-compute[74681]: INFO nova.compute.manager [None req-7d210995-b62d-4cdf-9f07-5ec6078b5178 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Unrescuing
Aug 16 06:27:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7d210995-b62d-4cdf-9f07-5ec6078b5178 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:27:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7d210995-b62d-4cdf-9f07-5ec6078b5178 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquired lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:27:11 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7d210995-b62d-4cdf-9f07-5ec6078b5178 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:27:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG nova.network.neutron [None req-7d210995-b62d-4cdf-9f07-5ec6078b5178 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updating instance_info_cache with network_info: [{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7d210995-b62d-4cdf-9f07-5ec6078b5178 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Releasing lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7d210995-b62d-4cdf-9f07-5ec6078b5178 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'flavor' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-807655a1-bae3-42b5-8f19-30be339b5b8c req-799c06b9-2279-4ce4-873e-e7c29d7e14b8 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-807655a1-bae3-42b5-8f19-30be339b5b8c req-799c06b9-2279-4ce4-873e-e7c29d7e14b8 service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-807655a1-bae3-42b5-8f19-30be339b5b8c req-799c06b9-2279-4ce4-873e-e7c29d7e14b8 service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-807655a1-bae3-42b5-8f19-30be339b5b8c req-799c06b9-2279-4ce4-873e-e7c29d7e14b8 service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-807655a1-bae3-42b5-8f19-30be339b5b8c req-799c06b9-2279-4ce4-873e-e7c29d7e14b8 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:12 user nova-compute[74681]: WARNING nova.compute.manager [req-807655a1-bae3-42b5-8f19-30be339b5b8c req-799c06b9-2279-4ce4-873e-e7c29d7e14b8 service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:27:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:13 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance destroyed successfully.
Aug 16 06:27:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-6c3b52f1-a063-4aba-8825-7fad49fe2528 req-956f8330-ee39-4cc9-a505-3f76e56d535b service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6c3b52f1-a063-4aba-8825-7fad49fe2528 req-956f8330-ee39-4cc9-a505-3f76e56d535b service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6c3b52f1-a063-4aba-8825-7fad49fe2528 req-956f8330-ee39-4cc9-a505-3f76e56d535b service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6c3b52f1-a063-4aba-8825-7fad49fe2528 req-956f8330-ee39-4cc9-a505-3f76e56d535b service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-6c3b52f1-a063-4aba-8825-7fad49fe2528 req-956f8330-ee39-4cc9-a505-3f76e56d535b service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:14 user nova-compute[74681]: WARNING nova.compute.manager [req-6c3b52f1-a063-4aba-8825-7fad49fe2528 req-956f8330-ee39-4cc9-a505-3f76e56d535b service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:27:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:16 user nova-compute[74681]: WARNING nova.compute.manager [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:27:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:16 user nova-compute[74681]: WARNING nova.compute.manager [req-cacdca51-ff8c-4221-9697-d7a7e757d2fa req-abd73b86-8b27-412f-a239-f47239a7e5ea service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for b581cf93-c19c-4d1f-a000-113a548ee755 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167237.0169764, b581cf93-c19c-4d1f-a000-113a548ee755 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] VM Resumed (Lifecycle Event)
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7d210995-b62d-4cdf-9f07-5ec6078b5178 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167237.0184805, b581cf93-c19c-4d1f-a000-113a548ee755 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] VM Started (Lifecycle Event)
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "195ea078-71f3-494a-ac7f-8c84992287b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "195ea078-71f3-494a-ac7f-8c84992287b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:27:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:18 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:27:18 user nova-compute[74681]: INFO nova.compute.claims [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Claim successful on node user
Aug 16 06:27:18 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:27:18 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:27:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:27:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:27:18 user nova-compute[74681]: DEBUG nova.network.neutron [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:27:18 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:27:19 user nova-compute[74681]: DEBUG nova.policy [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd0444b91944ba5b2d1e3c852456964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbdfedd72a4b38aaa5acd93ac18163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:27:19 user nova-compute[74681]: INFO nova.virt.block_device [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Booting with volume 586a7d92-5392-4e8a-96c0-6f2b7de4494b at /dev/vda
Aug 16 06:27:19 user nova-compute[74681]: DEBUG os_brick.utils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[634ef3a1-9651-4558-a2f9-55188baf28b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95d3ef8-0e99-49cc-84f7-2fbb841efb86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a77506-a6f1-4325-8e80-7b977f569fe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e530821d-8d82-4ebb-8040-a744a73c5490]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:27:19 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:27:19 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fc5852-a82f-41e0-bacc-2ec43a9877e6]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG os_brick.utils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:27:19 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Updating existing volume attachment record: 12c1899a-2a00-4e24-bfd7-76f563bef012 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:27:20 user nova-compute[74681]: DEBUG nova.network.neutron [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Successfully created port: 06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Successfully updated port: 06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-4e32fce2-c369-49f0-8b96-b02b2965c744 req-82090358-09ab-44db-9120-6ac1b07754df service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received event network-changed-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-4e32fce2-c369-49f0-8b96-b02b2965c744 req-82090358-09ab-44db-9120-6ac1b07754df service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Refreshing instance network info cache due to event network-changed-06c9048f-7189-4901-b674-14b4b86f6a1c. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e32fce2-c369-49f0-8b96-b02b2965c744 req-82090358-09ab-44db-9120-6ac1b07754df service nova] Acquiring lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e32fce2-c369-49f0-8b96-b02b2965c744 req-82090358-09ab-44db-9120-6ac1b07754df service nova] Acquired lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG nova.network.neutron [req-4e32fce2-c369-49f0-8b96-b02b2965c744 req-82090358-09ab-44db-9120-6ac1b07754df service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Refreshing network info cache for port 06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:27:21 user nova-compute[74681]: DEBUG nova.network.neutron [req-4e32fce2-c369-49f0-8b96-b02b2965c744 req-82090358-09ab-44db-9120-6ac1b07754df service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.network.neutron [req-4e32fce2-c369-49f0-8b96-b02b2965c744 req-82090358-09ab-44db-9120-6ac1b07754df service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4e32fce2-c369-49f0-8b96-b02b2965c744 req-82090358-09ab-44db-9120-6ac1b07754df service nova] Releasing lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquired lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-fdc2c88b-2bfb-41f8-8cd8-629156a4420f req-dc9e083c-c044-422d-bf0f-8f04c210ce51 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received event network-changed-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-fdc2c88b-2bfb-41f8-8cd8-629156a4420f req-dc9e083c-c044-422d-bf0f-8f04c210ce51 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Refreshing instance network info cache due to event network-changed-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fdc2c88b-2bfb-41f8-8cd8-629156a4420f req-dc9e083c-c044-422d-bf0f-8f04c210ce51 service nova] Acquiring lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fdc2c88b-2bfb-41f8-8cd8-629156a4420f req-dc9e083c-c044-422d-bf0f-8f04c210ce51 service nova] Acquired lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.network.neutron [req-fdc2c88b-2bfb-41f8-8cd8-629156a4420f req-dc9e083c-c044-422d-bf0f-8f04c210ce51 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Refreshing network info cache for port f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Updating instance_info_cache with network_info: [{"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Releasing lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Instance network_info: |[{"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.network.neutron [req-fdc2c88b-2bfb-41f8-8cd8-629156a4420f req-dc9e083c-c044-422d-bf0f-8f04c210ce51 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Updated VIF entry in instance network info cache for port f76ff58a-b1fe-472b-a4d4-92b2ca009d8a. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG nova.network.neutron [req-fdc2c88b-2bfb-41f8-8cd8-629156a4420f req-dc9e083c-c044-422d-bf0f-8f04c210ce51 service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Updating instance_info_cache with network_info: [{"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:27:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fdc2c88b-2bfb-41f8-8cd8-629156a4420f req-dc9e083c-c044-422d-bf0f-8f04c210ce51 service nova] Releasing lock "refresh_cache-6370394e-c0c1-40e2-9693-b5d5a333289d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG nova.objects.instance [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'flavor' on Instance uuid 6370394e-c0c1-40e2-9693-b5d5a333289d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Ignoring supplied device name: /dev/vdb
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:23 user nova-compute[74681]: INFO nova.compute.manager [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Attaching volume a1e83a57-1b13-4c20-b5e9-852552498239 to /dev/vdb
Aug 16 06:27:23 user nova-compute[74681]: DEBUG os_brick.utils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[91afaeed-9010-4756-b680-2f85f5283c7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd38987-1e96-41bd-ad72-2ab2272b8056]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee913e-d1aa-411a-9db4-c3fbd00d5a8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f267ee03-cb12-4aa5-af4f-bba3329dcb21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:27:23 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:27:23 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d46c557-0682-407a-95e3-067389754024]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG os_brick.utils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:27:23 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Updating existing volume attachment record: fda4f464-b166-4ace-b63a-f51cf92a5f14 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:27:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:27:29 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Creating image(s)
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Ensure instance console log exists: /opt/stack/data/nova/instances/195ea078-71f3-494a-ac7f-8c84992287b3/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Start _get_guest_xml network_info=[{"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '12c1899a-2a00-4e24-bfd7-76f563bef012', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrUYvtCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '195ea078-71f3-494a-ac7f-8c84992287b3', 'attached_at': '', 'detached_at': '', 'volume_id': '586a7d92-5392-4e8a-96c0-6f2b7de4494b', 'serial': '586a7d92-5392-4e8a-96c0-6f2b7de4494b'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:27:29 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:27:29 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:27:29 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrUYvtCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:27:30 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:27:30 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:27:30 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd82e846-114d-405a-bb0a-89a2f8870ac5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:27:30 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b917c302-cbeb-475f-90b4-32ce88d5f781]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b] added
Aug 16 06:27:30 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f5a891-0e96-407b-b9a2-77665ce1acb4]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e16a60-59ed-4a2c-a09b-83acf2bdefa0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrUYvtCH {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrUYvtCH" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b361929-1dc6-47fd-a667-570c70fe8861]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MrUYvtCH'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb2aa19-9856-4ee7-a35c-148640be0d14]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[007fd425-605d-4047-b6bd-c5ac6aa7f3a4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:27:30 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:27:30 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ee1e54-62e9-44c0-86c0-33dfb0d3cf01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b, portal: 172.16.0.220,3260]
Aug 16 06:27:30 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b, portal: 172.16.0.220,3260] successful.
Aug 16 06:27:30 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb60355b-da76-4182-b8f4-a0bad5ba0155]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2122b304-dd99-4f72-8a82-b9ffdb75b133]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:27:30 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:27:30 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:27:30 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97d53a-8338-457e-a52a-fa1a03358d81]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:27:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrUYvtCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26361663665303438', 'path': '/dev/sde'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361663665303438', 'path': '/dev/sde'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1919211299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1919211299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1919211299',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwYVyy5mJ/CCGvAnpuRMjprY6Xtndfda3Tl/z96gfWTXofNPf3n3KU78ojB2N19/h4p3hhURDU4+snWuGv5CTHDFXTvupBFDkhvY/o5K6hZkD+qfuJXdSuqZwPGGWAKHg==',key_name='tempest-keypair-957897090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-qr776drq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd0444b91944ba5b2d1e3c852456964',uuid=195ea078-71f3-494a-ac7f-8c84992287b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:c7,bridge_name='br-int',has_traffic_filtering=True,id=06c9048f-7189-4901-b674-14b4b86f6a1c,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c9048f-71') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'pci_devices' on Instance uuid 195ea078-71f3-494a-ac7f-8c84992287b3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:27:31 user nova-compute[74681]:   <uuid>195ea078-71f3-494a-ac7f-8c84992287b3</uuid>
Aug 16 06:27:31 user nova-compute[74681]:   <name>instance-00000028</name>
Aug 16 06:27:31 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:27:31 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:27:31 user nova-compute[74681]:   <metadata>
Aug 16 06:27:31 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:27:31 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:27:31 user nova-compute[74681]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1919211299</nova:name>
Aug 16 06:27:31 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:27:29</nova:creationTime>
Aug 16 06:27:31 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:27:31 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:27:31 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:27:31 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:27:31 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:27:31 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:27:31 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:27:31 user nova-compute[74681]:       <nova:owner>
Aug 16 06:27:31 user nova-compute[74681]:         <nova:user uuid="efd0444b91944ba5b2d1e3c852456964">tempest-TestVolumeBootPattern-702107063-project-member</nova:user>
Aug 16 06:27:31 user nova-compute[74681]:         <nova:project uuid="3fbbdfedd72a4b38aaa5acd93ac18163">tempest-TestVolumeBootPattern-702107063</nova:project>
Aug 16 06:27:31 user nova-compute[74681]:       </nova:owner>
Aug 16 06:27:31 user nova-compute[74681]:       <nova:ports>
Aug 16 06:27:31 user nova-compute[74681]:         <nova:port uuid="06c9048f-7189-4901-b674-14b4b86f6a1c">
Aug 16 06:27:31 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 06:27:31 user nova-compute[74681]:         </nova:port>
Aug 16 06:27:31 user nova-compute[74681]:       </nova:ports>
Aug 16 06:27:31 user nova-compute[74681]:     </nova:instance>
Aug 16 06:27:31 user nova-compute[74681]:   </metadata>
Aug 16 06:27:31 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:27:31 user nova-compute[74681]:     <system>
Aug 16 06:27:31 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:27:31 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:27:31 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:27:31 user nova-compute[74681]:       <entry name="serial">195ea078-71f3-494a-ac7f-8c84992287b3</entry>
Aug 16 06:27:31 user nova-compute[74681]:       <entry name="uuid">195ea078-71f3-494a-ac7f-8c84992287b3</entry>
Aug 16 06:27:31 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:27:31 user nova-compute[74681]:     </system>
Aug 16 06:27:31 user nova-compute[74681]:   </sysinfo>
Aug 16 06:27:31 user nova-compute[74681]:   <os>
Aug 16 06:27:31 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:27:31 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:27:31 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:27:31 user nova-compute[74681]:   </os>
Aug 16 06:27:31 user nova-compute[74681]:   <features>
Aug 16 06:27:31 user nova-compute[74681]:     <acpi/>
Aug 16 06:27:31 user nova-compute[74681]:     <apic/>
Aug 16 06:27:31 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:27:31 user nova-compute[74681]:   </features>
Aug 16 06:27:31 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:27:31 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:27:31 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:27:31 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:27:31 user nova-compute[74681]:   </clock>
Aug 16 06:27:31 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:27:31 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:27:31 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:27:31 user nova-compute[74681]:   </cpu>
Aug 16 06:27:31 user nova-compute[74681]:   <devices>
Aug 16 06:27:31 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:27:31 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:27:31 user nova-compute[74681]:       <source dev="/dev/sde"/>
Aug 16 06:27:31 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:27:31 user nova-compute[74681]:       <serial>586a7d92-5392-4e8a-96c0-6f2b7de4494b</serial>
Aug 16 06:27:31 user nova-compute[74681]:     </disk>
Aug 16 06:27:31 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:27:31 user nova-compute[74681]:       <mac address="fa:16:3e:7c:1c:c7"/>
Aug 16 06:27:31 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:27:31 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:27:31 user nova-compute[74681]:       <target dev="tap06c9048f-71"/>
Aug 16 06:27:31 user nova-compute[74681]:     </interface>
Aug 16 06:27:31 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:27:31 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/195ea078-71f3-494a-ac7f-8c84992287b3/console.log" append="off"/>
Aug 16 06:27:31 user nova-compute[74681]:     </serial>
Aug 16 06:27:31 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:27:31 user nova-compute[74681]:     <video>
Aug 16 06:27:31 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:27:31 user nova-compute[74681]:     </video>
Aug 16 06:27:31 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:27:31 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:27:31 user nova-compute[74681]:     </rng>
Aug 16 06:27:31 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:27:31 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:27:31 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:27:31 user nova-compute[74681]:     </memballoon>
Aug 16 06:27:31 user nova-compute[74681]:   </devices>
Aug 16 06:27:31 user nova-compute[74681]: </domain>
Aug 16 06:27:31 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1919211299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1919211299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1919211299',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwYVyy5mJ/CCGvAnpuRMjprY6Xtndfda3Tl/z96gfWTXofNPf3n3KU78ojB2N19/h4p3hhURDU4+snWuGv5CTHDFXTvupBFDkhvY/o5K6hZkD+qfuJXdSuqZwPGGWAKHg==',key_name='tempest-keypair-957897090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-qr776drq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd0444b91944ba5b2d1e3c852456964',uuid=195ea078-71f3-494a-ac7f-8c84992287b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:c7,bridge_name='br-int',has_traffic_filtering=True,id=06c9048f-7189-4901-b674-14b4b86f6a1c,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c9048f-71') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG os_vif [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:c7,bridge_name='br-int',has_traffic_filtering=True,id=06c9048f-7189-4901-b674-14b4b86f6a1c,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c9048f-71') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06c9048f-71, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06c9048f-71, col_values=(('external_ids', {'iface-id': '06c9048f-7189-4901-b674-14b4b86f6a1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:1c:c7', 'vm-uuid': '195ea078-71f3-494a-ac7f-8c84992287b3'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:31 user nova-compute[74681]: INFO os_vif [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:1c:c7,bridge_name='br-int',has_traffic_filtering=True,id=06c9048f-7189-4901-b674-14b4b86f6a1c,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c9048f-71')
Aug 16 06:27:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:27:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No VIF found with MAC fa:16:3e:7c:1c:c7, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:27:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-560956d3-564a-42cb-b8c9-64b0ead508be req-ff1fd2c9-b142-44c1-a2c8-80e01dd1016b service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received event network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-560956d3-564a-42cb-b8c9-64b0ead508be req-ff1fd2c9-b142-44c1-a2c8-80e01dd1016b service nova] Acquiring lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-560956d3-564a-42cb-b8c9-64b0ead508be req-ff1fd2c9-b142-44c1-a2c8-80e01dd1016b service nova] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-560956d3-564a-42cb-b8c9-64b0ead508be req-ff1fd2c9-b142-44c1-a2c8-80e01dd1016b service nova] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-560956d3-564a-42cb-b8c9-64b0ead508be req-ff1fd2c9-b142-44c1-a2c8-80e01dd1016b service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] No waiting events found dispatching network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:33 user nova-compute[74681]: WARNING nova.compute.manager [req-560956d3-564a-42cb-b8c9-64b0ead508be req-ff1fd2c9-b142-44c1-a2c8-80e01dd1016b service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received unexpected event network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c for instance with vm_state building and task_state spawning.
Aug 16 06:27:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-3c1922b6-c0be-42d4-8e86-73867cf76a7b req-bb82dd14-0c77-40a5-bbe6-1bece4460fb2 service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received event network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3c1922b6-c0be-42d4-8e86-73867cf76a7b req-bb82dd14-0c77-40a5-bbe6-1bece4460fb2 service nova] Acquiring lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3c1922b6-c0be-42d4-8e86-73867cf76a7b req-bb82dd14-0c77-40a5-bbe6-1bece4460fb2 service nova] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3c1922b6-c0be-42d4-8e86-73867cf76a7b req-bb82dd14-0c77-40a5-bbe6-1bece4460fb2 service nova] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-3c1922b6-c0be-42d4-8e86-73867cf76a7b req-bb82dd14-0c77-40a5-bbe6-1bece4460fb2 service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] No waiting events found dispatching network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:35 user nova-compute[74681]: WARNING nova.compute.manager [req-3c1922b6-c0be-42d4-8e86-73867cf76a7b req-bb82dd14-0c77-40a5-bbe6-1bece4460fb2 service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received unexpected event network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c for instance with vm_state building and task_state spawning.
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167255.2734861, 195ea078-71f3-494a-ac7f-8c84992287b3 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:35 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] VM Resumed (Lifecycle Event)
Aug 16 06:27:35 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Instance spawned successfully.
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:35 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167255.2737477, 195ea078-71f3-494a-ac7f-8c84992287b3 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:35 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] VM Started (Lifecycle Event)
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:35 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:27:35 user nova-compute[74681]: INFO nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 16 06:27:35 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:35 user nova-compute[74681]: INFO nova.compute.manager [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Took 17.49 seconds to build instance.
Aug 16 06:27:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9ab7581a-1c09-4ec8-84da-7a85c07344b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "195ea078-71f3-494a-ac7f-8c84992287b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.589s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:40 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:27:40 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquired lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:27:40 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:27:40 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'info_cache' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updating instance_info_cache with network_info: [{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Releasing lock "refresh_cache-6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:27:41 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance destroyed successfully.
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'resources' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG os_vif [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2886dcc-da, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:27:41 user nova-compute[74681]: INFO os_vif [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da')
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Start _get_guest_xml network_info=[{"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'numa_topology' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:41 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:27:41 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'pci_devices' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:27:41 user nova-compute[74681]:   <uuid>6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</uuid>
Aug 16 06:27:41 user nova-compute[74681]:   <name>instance-0000001c</name>
Aug 16 06:27:41 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:27:41 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:27:41 user nova-compute[74681]:   <metadata>
Aug 16 06:27:41 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:27:41 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:27:41 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeTestJSON-server-1103772826</nova:name>
Aug 16 06:27:41 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:27:41</nova:creationTime>
Aug 16 06:27:41 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:27:41 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:27:41 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:27:41 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:27:41 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:27:41 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:27:41 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:27:41 user nova-compute[74681]:       <nova:owner>
Aug 16 06:27:41 user nova-compute[74681]:         <nova:user uuid="ca629fd2ab8b4728a772af22f19f48e1">tempest-AttachVolumeTestJSON-436096878-project-member</nova:user>
Aug 16 06:27:41 user nova-compute[74681]:         <nova:project uuid="d50b9e6e8d18446baeb39b48b22aa64d">tempest-AttachVolumeTestJSON-436096878</nova:project>
Aug 16 06:27:41 user nova-compute[74681]:       </nova:owner>
Aug 16 06:27:41 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:27:41 user nova-compute[74681]:       <nova:ports>
Aug 16 06:27:41 user nova-compute[74681]:         <nova:port uuid="f2886dcc-dad5-4242-a05f-e88b51734354">
Aug 16 06:27:41 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 06:27:41 user nova-compute[74681]:         </nova:port>
Aug 16 06:27:41 user nova-compute[74681]:       </nova:ports>
Aug 16 06:27:41 user nova-compute[74681]:     </nova:instance>
Aug 16 06:27:41 user nova-compute[74681]:   </metadata>
Aug 16 06:27:41 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:27:41 user nova-compute[74681]:     <system>
Aug 16 06:27:41 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:27:41 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:27:41 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:27:41 user nova-compute[74681]:       <entry name="serial">6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</entry>
Aug 16 06:27:41 user nova-compute[74681]:       <entry name="uuid">6297f1b7-34ea-4481-8d21-ead2bf0b3d2a</entry>
Aug 16 06:27:41 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:27:41 user nova-compute[74681]:     </system>
Aug 16 06:27:41 user nova-compute[74681]:   </sysinfo>
Aug 16 06:27:41 user nova-compute[74681]:   <os>
Aug 16 06:27:41 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:27:41 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:27:41 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:27:41 user nova-compute[74681]:   </os>
Aug 16 06:27:41 user nova-compute[74681]:   <features>
Aug 16 06:27:41 user nova-compute[74681]:     <acpi/>
Aug 16 06:27:41 user nova-compute[74681]:     <apic/>
Aug 16 06:27:41 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:27:41 user nova-compute[74681]:   </features>
Aug 16 06:27:41 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:27:41 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:27:41 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:27:41 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:27:41 user nova-compute[74681]:   </clock>
Aug 16 06:27:41 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:27:41 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:27:41 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:27:41 user nova-compute[74681]:   </cpu>
Aug 16 06:27:41 user nova-compute[74681]:   <devices>
Aug 16 06:27:41 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:27:41 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:27:41 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk"/>
Aug 16 06:27:41 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:27:41 user nova-compute[74681]:     </disk>
Aug 16 06:27:41 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:27:41 user nova-compute[74681]:       <mac address="fa:16:3e:c6:73:6f"/>
Aug 16 06:27:41 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:27:41 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:27:41 user nova-compute[74681]:       <target dev="tapf2886dcc-da"/>
Aug 16 06:27:41 user nova-compute[74681]:     </interface>
Aug 16 06:27:41 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:27:41 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/console.log" append="off"/>
Aug 16 06:27:41 user nova-compute[74681]:     </serial>
Aug 16 06:27:41 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:27:41 user nova-compute[74681]:     <video>
Aug 16 06:27:41 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:27:41 user nova-compute[74681]:     </video>
Aug 16 06:27:41 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:27:41 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:27:41 user nova-compute[74681]:     </rng>
Aug 16 06:27:41 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:27:41 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:27:41 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:27:41 user nova-compute[74681]:     </memballoon>
Aug 16 06:27:41 user nova-compute[74681]:   </devices>
Aug 16 06:27:41 user nova-compute[74681]: </domain>
Aug 16 06:27:41 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:27:41 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Cannot resize image /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'migration_context' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG os_vif [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2886dcc-da, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2886dcc-da, col_values=(('external_ids', {'iface-id': 'f2886dcc-dad5-4242-a05f-e88b51734354', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:73:6f', 'vm-uuid': '6297f1b7-34ea-4481-8d21-ead2bf0b3d2a'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:27:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:42 user nova-compute[74681]: INFO os_vif [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da')
Aug 16 06:27:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPhknQAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:27:43 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:27:43 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:27:43 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb84373b-adf0-4d72-b29b-8dd5982ef464]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:27:43 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c488f5-630c-4114-a031-cc9b3db1a657]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239] added
Aug 16 06:27:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c5574-07a4-45d6-bf55-03fcfa68912d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a16fca-3321-4412-9600-81f3418ad6be]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPhknQAK {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPhknQAK" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a09d7c-5471-41c5-adec-af81ed7495d1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPhknQAK'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d926d-7569-441d-bfea-e54f5ea12a56]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccac88dd-95c7-4d0f-98f4-e9fdd967d8fa]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:27:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:27:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c0ed3-ab89-4ff0-9f09-2fdbf5c70eed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239, portal: 172.16.0.220,3260]
Aug 16 06:27:43 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239, portal: 172.16.0.220,3260] successful.
Aug 16 06:27:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbf6f1c-84d5-4463-aaa5-35e4440da6ac]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d14e622-f256-4883-83ec-64189103aa2b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 (non-flash)
Aug 16 06:27:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:27:43 user nova-compute[74681]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 (non-flash)
Aug 16 06:27:43 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[42365534-81d5-434c-a194-52614699ab3f]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPhknQAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-b253fff2-d2e4-436a-817a-e8cd7e83750b req-0cd82ef1-9209-44cc-b2e9-049c5911c811 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b253fff2-d2e4-436a-817a-e8cd7e83750b req-0cd82ef1-9209-44cc-b2e9-049c5911c811 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b253fff2-d2e4-436a-817a-e8cd7e83750b req-0cd82ef1-9209-44cc-b2e9-049c5911c811 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b253fff2-d2e4-436a-817a-e8cd7e83750b req-0cd82ef1-9209-44cc-b2e9-049c5911c811 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-b253fff2-d2e4-436a-817a-e8cd7e83750b req-0cd82ef1-9209-44cc-b2e9-049c5911c811 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:43 user nova-compute[74681]: WARNING nova.compute.manager [req-b253fff2-d2e4-436a-817a-e8cd7e83750b req-0cd82ef1-9209-44cc-b2e9-049c5911c811 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state stopped and task_state powering-on.
Aug 16 06:27:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:27:44 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23162633334303536', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:27:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162633334303536', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:27:44 user nova-compute[74681]: DEBUG nova.objects.instance [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'flavor' on Instance uuid 6370394e-c0c1-40e2-9693-b5d5a333289d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:27:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:27:44 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:27:44 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:27:44 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:27:44 user nova-compute[74681]:   <serial>a1e83a57-1b13-4c20-b5e9-852552498239</serial>
Aug 16 06:27:44 user nova-compute[74681]: </disk>
Aug 16 06:27:44 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No VIF found with MAC fa:16:3e:99:5d:4a, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-095685df-f1ea-43c8-a253-dd626b25069c tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.450s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167265.8189294, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:45 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Resumed (Lifecycle Event)
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:27:45 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance rebooted successfully.
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2448e495-3571-4b8d-b72b-b55fd24d9293 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:45 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167265.820646, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:27:45 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Started (Lifecycle Event)
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-8fc2b7b1-0905-4816-9ebd-fb337556745f req-7451e6dc-6d27-4616-8326-7a66980bd4c0 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8fc2b7b1-0905-4816-9ebd-fb337556745f req-7451e6dc-6d27-4616-8326-7a66980bd4c0 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8fc2b7b1-0905-4816-9ebd-fb337556745f req-7451e6dc-6d27-4616-8326-7a66980bd4c0 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8fc2b7b1-0905-4816-9ebd-fb337556745f req-7451e6dc-6d27-4616-8326-7a66980bd4c0 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-8fc2b7b1-0905-4816-9ebd-fb337556745f req-7451e6dc-6d27-4616-8326-7a66980bd4c0 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:27:45 user nova-compute[74681]: WARNING nova.compute.manager [req-8fc2b7b1-0905-4816-9ebd-fb337556745f req-7451e6dc-6d27-4616-8326-7a66980bd4c0 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state stopped and task_state powering-on.
Aug 16 06:27:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:47 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue --force-share --output=json" returned: 0 in 0.290s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk.rescue --force-share --output=json" returned: 0 in 0.270s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:27:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:27:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:27:50 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:27:50 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:27:50 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7241MB free_disk=25.10584259033203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:27:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:27:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6370394e-c0c1-40e2-9693-b5d5a333289d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 195ea078-71f3-494a-ac7f-8c84992287b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:27:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.748s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Didn't find any instances for network info cache update. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:27:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:27:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:27:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:28:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:28:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:28:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:28:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:28:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:28 user nova-compute[74681]: INFO nova.compute.manager [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Detaching volume a1e83a57-1b13-4c20-b5e9-852552498239
Aug 16 06:28:28 user nova-compute[74681]: INFO nova.virt.block_device [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Attempting to driver detach volume a1e83a57-1b13-4c20-b5e9-852552498239 from mountpoint /dev/vdb
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Attempting to detach device vdb from instance 6370394e-c0c1-40e2-9693-b5d5a333289d from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:28:29 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:28:29 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:28:29 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:28:29 user nova-compute[74681]:   <serial>a1e83a57-1b13-4c20-b5e9-852552498239</serial>
Aug 16 06:28:29 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:28:29 user nova-compute[74681]: </disk>
Aug 16 06:28:29 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:28:29 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Successfully detached device vdb from instance 6370394e-c0c1-40e2-9693-b5d5a333289d from the persistent domain config.
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6370394e-c0c1-40e2-9693-b5d5a333289d from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:28:29 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:28:29 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:28:29 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:28:29 user nova-compute[74681]:   <serial>a1e83a57-1b13-4c20-b5e9-852552498239</serial>
Aug 16 06:28:29 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:28:29 user nova-compute[74681]: </disk>
Aug 16 06:28:29 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-65d304dc-9b07-4b70-9bd7-ed9f986e469c req-0823f807-454b-4107-9073-39543b453019 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-changed-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-65d304dc-9b07-4b70-9bd7-ed9f986e469c req-0823f807-454b-4107-9073-39543b453019 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Refreshing instance network info cache due to event network-changed-395eef1a-74ab-41c3-b9d0-db18c0cfbb82. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-65d304dc-9b07-4b70-9bd7-ed9f986e469c req-0823f807-454b-4107-9073-39543b453019 service nova] Acquiring lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-65d304dc-9b07-4b70-9bd7-ed9f986e469c req-0823f807-454b-4107-9073-39543b453019 service nova] Acquired lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-65d304dc-9b07-4b70-9bd7-ed9f986e469c req-0823f807-454b-4107-9073-39543b453019 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Refreshing network info cache for port 395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167309.5165422, 6370394e-c0c1-40e2-9693-b5d5a333289d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6370394e-c0c1-40e2-9693-b5d5a333289d {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:28:29 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Successfully detached device vdb from instance 6370394e-c0c1-40e2-9693-b5d5a333289d from the live domain config.
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPhknQAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:28:29 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5961273-bbb3-4387-a357-bde6bcf3f4fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d98191-1c3b-4554-9632-3804870c0696]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:29 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:29 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:28:29 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:29 user nova-compute[74681]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 (non-flash)
Aug 16 06:28:29 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:29 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:29 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:28:29 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:29 user nova-compute[74681]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 (non-flash)
Aug 16 06:28:29 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94841e9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239'): ({'sdf'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Removing single pathed devices sdf {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34e0a91-ee23-4822-a380-f3e06b61d562]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef42406-d527-42db-a2b8-4527c232bc91]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Flushing IO for device /dev/sdf {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c85108e-ae9d-413e-9895-075d82b2dad2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[01396af2-59ee-44cc-86ae-715e1e1f181f]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d77d5d4-5e09-4c23-9bc1-ca1c2fca8479]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[291fa624-f90b-43a2-a498-80fc1a0fdc27]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239, portal: 172.16.0.220,3260]
Aug 16 06:28:29 user nova-compute[74681]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239, portal: 172.16.0.220,3260] successful.
Aug 16 06:28:29 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[192abcd1-5ebc-45a2-904a-3182e8b8bdac]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] <== disconnect_volume: return (301ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-65d304dc-9b07-4b70-9bd7-ed9f986e469c req-0823f807-454b-4107-9073-39543b453019 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updated VIF entry in instance network info cache for port 395eef1a-74ab-41c3-b9d0-db18c0cfbb82. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-65d304dc-9b07-4b70-9bd7-ed9f986e469c req-0823f807-454b-4107-9073-39543b453019 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:28:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-65d304dc-9b07-4b70-9bd7-ed9f986e469c req-0823f807-454b-4107-9073-39543b453019 service nova] Releasing lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'flavor' on Instance uuid 6370394e-c0c1-40e2-9693-b5d5a333289d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-39658f80-39b1-4855-a504-364ce00c6644 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.827s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.690s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:30 user nova-compute[74681]: INFO nova.compute.manager [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Terminating instance
Aug 16 06:28:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Stashing vm_state: active {{(pid=74681) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.objects.instance [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'pci_requests' on Instance uuid 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:28:31 user nova-compute[74681]: INFO nova.compute.claims [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Claim successful on node user
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.objects.instance [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'resources' on Instance uuid 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.objects.instance [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:31 user nova-compute[74681]: INFO nova.compute.resource_tracker [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating resource usage from migration da20cfa5-a09a-4256-b150-e799a412039d
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-changed-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Refreshing instance network info cache due to event network-changed-19c41113-5a63-4592-ac7b-88104f472bab. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Acquiring lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Acquired lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Refreshing network info cache for port 19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Instance destroyed successfully.
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'resources' on Instance uuid 6370394e-c0c1-40e2-9693-b5d5a333289d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:25:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2047769346',display_name='tempest-VolumesSnapshotTestJSON-instance-2047769346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2047769346',id=37,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD314Khrzr+lhybFGQApnSELtS9qoWvnJgGJktl5XgTnlwY2ZhmltZbxFpI+MH8X4Ptj1oh5yB5nU79b2bQ0lRRXX77QZKEDci7cpitr0kqEopcvG/VAbzBHBi0xX1HtVA==',key_name='tempest-keypair-2022894617',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:25:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01ba755546fe440591b1292c5d74a8f2',ramdisk_id='',reservation_id='r-do7qt8dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-848952719',owner_user_name='tempest-VolumesSnapshotTestJSON-848952719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:25:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='586e737fe78c4bf180d51f0470bd8648',uuid=6370394e-c0c1-40e2-9693-b5d5a333289d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converting VIF {"id": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "address": "fa:16:3e:99:5d:4a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76ff58a-b1", "ovs_interfaceid": "f76ff58a-b1fe-472b-a4d4-92b2ca009d8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:5d:4a,bridge_name='br-int',has_traffic_filtering=True,id=f76ff58a-b1fe-472b-a4d4-92b2ca009d8a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76ff58a-b1') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_vif [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:5d:4a,bridge_name='br-int',has_traffic_filtering=True,id=f76ff58a-b1fe-472b-a4d4-92b2ca009d8a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76ff58a-b1') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf76ff58a-b1, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:28:31 user nova-compute[74681]: INFO os_vif [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:5d:4a,bridge_name='br-int',has_traffic_filtering=True,id=f76ff58a-b1fe-472b-a4d4-92b2ca009d8a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76ff58a-b1')
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPhknQAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:28:31 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e83a57-1b13-4c20-b5e9-852552498239', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31ca476-4b13-440a-bb1b-ac1470d569bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4de322-0ff5-4c29-8cca-502c1b33cc9e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:31 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:31 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:28:31 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:31 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:31 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:31 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:28:31 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:31 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948461a050>, {}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Disconnecting from: [] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] <== disconnect_volume: return (57ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:28:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Deleting instance files /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d_del
Aug 16 06:28:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Deletion of /opt/stack/data/nova/instances/6370394e-c0c1-40e2-9693-b5d5a333289d_del complete
Aug 16 06:28:31 user nova-compute[74681]: INFO nova.compute.manager [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.616s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:31 user nova-compute[74681]: INFO nova.compute.manager [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Migrating
Aug 16 06:28:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updated VIF entry in instance network info cache for port 19c41113-5a63-4592-ac7b-88104f472bab. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating instance_info_cache with network_info: [{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Releasing lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received event network-vif-unplugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] No waiting events found dispatching network-vif-unplugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received event network-vif-unplugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received event network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Acquiring lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] No waiting events found dispatching network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:32 user nova-compute[74681]: WARNING nova.compute.manager [req-eef4f0cb-13ab-4b67-862c-56f205cc9122 req-baca5dd9-d0bd-4328-afd0-6f22c3d516de service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received unexpected event network-vif-plugged-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a for instance with vm_state active and task_state deleting.
Aug 16 06:28:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquired lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:28:32 user nova-compute[74681]: DEBUG nova.network.neutron [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:28:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating instance_info_cache with network_info: [{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:28:33 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:28:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Releasing lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:28:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-ba86569c-a5fe-4150-8a77-40f8d879c862 req-60dc483c-a727-453f-90d5-c304590e239a service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Received event network-vif-deleted-f76ff58a-b1fe-472b-a4d4-92b2ca009d8a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:33 user nova-compute[74681]: INFO nova.compute.manager [req-ba86569c-a5fe-4150-8a77-40f8d879c862 req-60dc483c-a727-453f-90d5-c304590e239a service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Neutron deleted interface f76ff58a-b1fe-472b-a4d4-92b2ca009d8a; detaching it from the instance and deleting it from the info cache
Aug 16 06:28:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-ba86569c-a5fe-4150-8a77-40f8d879c862 req-60dc483c-a727-453f-90d5-c304590e239a service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:28:33 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Took 1.87 seconds to deallocate network for instance.
Aug 16 06:28:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-ba86569c-a5fe-4150-8a77-40f8d879c862 req-60dc483c-a727-453f-90d5-c304590e239a service nova] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Detach interface failed, port_id=f76ff58a-b1fe-472b-a4d4-92b2ca009d8a, reason: Instance 6370394e-c0c1-40e2-9693-b5d5a333289d could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:28:33 user nova-compute[74681]: WARNING nova.volume.cinder [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Attachment fda4f464-b166-4ace-b63a-f51cf92a5f14 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fda4f464-b166-4ace-b63a-f51cf92a5f14. (HTTP 404) (Request-ID: req-443d45e0-d96a-4c24-9d94-d168e0efa495)
Aug 16 06:28:33 user nova-compute[74681]: INFO nova.compute.manager [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Took 0.02 seconds to detach 1 volumes for instance.
Aug 16 06:28:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Starting migrate_disk_and_power_off {{(pid=74681) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 06:28:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-e50399d3-349a-4ecc-b2da-1bb0b9c95e63 req-fd90e459-78f0-46de-afb1-6248e5d52bde service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-unplugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e50399d3-349a-4ecc-b2da-1bb0b9c95e63 req-fd90e459-78f0-46de-afb1-6248e5d52bde service nova] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e50399d3-349a-4ecc-b2da-1bb0b9c95e63 req-fd90e459-78f0-46de-afb1-6248e5d52bde service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e50399d3-349a-4ecc-b2da-1bb0b9c95e63 req-fd90e459-78f0-46de-afb1-6248e5d52bde service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-e50399d3-349a-4ecc-b2da-1bb0b9c95e63 req-fd90e459-78f0-46de-afb1-6248e5d52bde service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] No waiting events found dispatching network-vif-unplugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:34 user nova-compute[74681]: WARNING nova.compute.manager [req-e50399d3-349a-4ecc-b2da-1bb0b9c95e63 req-fd90e459-78f0-46de-afb1-6248e5d52bde service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received unexpected event network-vif-unplugged-19c41113-5a63-4592-ac7b-88104f472bab for instance with vm_state active and task_state resize_migrating.
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:34 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Deleted allocations for instance 6370394e-c0c1-40e2-9693-b5d5a333289d
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f113f322-132a-4ee4-98fb-db3fc3a66a9f tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "6370394e-c0c1-40e2-9693-b5d5a333289d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.480s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance destroyed successfully.
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1241571183',display_name='tempest-ServerActionsTestOtherA-server-1241571183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1241571183',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-5k4khnid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=4cacaa1a-0734-4f8d-9e2a-f138bdd06553,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1597326283-network", "vif_mac": "fa:16:3e:80:4b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1597326283-network", "vif_mac": "fa:16:3e:80:4b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_vif [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19c41113-5a, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:34 user nova-compute[74681]: INFO os_vif [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a')
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwHWlah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:28:34 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a697fd4-eb60-4ed1-bd2e-d3ee5b21cc89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf3bac-9ede-4f45-953e-e5e5d7419dbd]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:34 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:34 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:28:34 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:34 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:34 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:34 user nova-compute[74681]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:28:34 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:34 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f949c763e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45c76e4-855c-4cfd-8ec8-649c7653845a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af0a8d5-f988-4bf1-b8a3-6e9bdf5b7cda]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e602f41c-b2b6-479c-b257-3c717de68194]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e55acf-7dff-431c-809f-cd756882c2e0]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ff3698-f687-40e4-8985-a044e5c5936e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a630563-ad3c-407d-9127-dd90f2d44c85]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260]
Aug 16 06:28:34 user nova-compute[74681]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260] successful.
Aug 16 06:28:34 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfb1898-d436-46bc-a5df-2361583bc982]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== disconnect_volume: return (301ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:28:34 user nova-compute[74681]: INFO nova.compute.manager [None req-f94c54d6-e8a2-450e-a9c3-6be279af5d4d tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Unrescuing
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f94c54d6-e8a2-450e-a9c3-6be279af5d4d tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f94c54d6-e8a2-450e-a9c3-6be279af5d4d tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquired lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:28:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f94c54d6-e8a2-450e-a9c3-6be279af5d4d tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f94c54d6-e8a2-450e-a9c3-6be279af5d4d tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating instance_info_cache with network_info: [{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f94c54d6-e8a2-450e-a9c3-6be279af5d4d tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Releasing lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f94c54d6-e8a2-450e-a9c3-6be279af5d4d tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'flavor' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-fd7ede48-85c2-4e5a-92bb-bb896bb6b673 req-6d9e718a-0ae6-4d76-ad33-fd07c8528a4b service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fd7ede48-85c2-4e5a-92bb-bb896bb6b673 req-6d9e718a-0ae6-4d76-ad33-fd07c8528a4b service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fd7ede48-85c2-4e5a-92bb-bb896bb6b673 req-6d9e718a-0ae6-4d76-ad33-fd07c8528a4b service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fd7ede48-85c2-4e5a-92bb-bb896bb6b673 req-6d9e718a-0ae6-4d76-ad33-fd07c8528a4b service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-fd7ede48-85c2-4e5a-92bb-bb896bb6b673 req-6d9e718a-0ae6-4d76-ad33-fd07c8528a4b service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:35 user nova-compute[74681]: WARNING nova.compute.manager [req-fd7ede48-85c2-4e5a-92bb-bb896bb6b673 req-6d9e718a-0ae6-4d76-ad33-fd07c8528a4b service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:28:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG nova.network.neutron [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Port 19c41113-5a63-4592-ac7b-88104f472bab binding to destination host user is already ACTIVE {{(pid=74681) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquired lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:28:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance destroyed successfully.
Aug 16 06:28:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-c72e580a-2103-4b30-bd90-834348aa6c0f req-23d23c0f-40f3-49e5-9fd9-1adaea5b344f service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c72e580a-2103-4b30-bd90-834348aa6c0f req-23d23c0f-40f3-49e5-9fd9-1adaea5b344f service nova] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c72e580a-2103-4b30-bd90-834348aa6c0f req-23d23c0f-40f3-49e5-9fd9-1adaea5b344f service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c72e580a-2103-4b30-bd90-834348aa6c0f req-23d23c0f-40f3-49e5-9fd9-1adaea5b344f service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-c72e580a-2103-4b30-bd90-834348aa6c0f req-23d23c0f-40f3-49e5-9fd9-1adaea5b344f service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] No waiting events found dispatching network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:36 user nova-compute[74681]: WARNING nova.compute.manager [req-c72e580a-2103-4b30-bd90-834348aa6c0f req-23d23c0f-40f3-49e5-9fd9-1adaea5b344f service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received unexpected event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab for instance with vm_state active and task_state resize_migrated.
Aug 16 06:28:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating instance_info_cache with network_info: [{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Releasing lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG os_brick.utils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99e6c9e-cf92-4c4d-8f2a-b003c3d46bce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e5c076-935b-4f67-92e9-01489425ca2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee7f1cc-57b8-44e4-bce0-2ad5bc1f0f41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82f6e04-90a6-4e44-aebf-6821f2b4e7dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:28:36 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:28:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[173fb0d5-a5bb-43e4-94e7-131312d72a48]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:28:36 user nova-compute[74681]: DEBUG os_brick.utils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:37 user nova-compute[74681]: WARNING nova.compute.manager [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:28:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:37 user nova-compute[74681]: WARNING nova.compute.manager [req-035ecaba-51be-45a7-9d0b-c3e3de815bf0 req-e8b15ca9-b540-4ec3-b422-58f47390aa77 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:28:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167319.7982383, 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:28:39 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] VM Resumed (Lifecycle Event)
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f94c54d6-e8a2-450e-a9c3-6be279af5d4d tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-375e8c8e-3c2e-4a4c-ad3c-0d7bcd91896a req-263716ea-c84f-4afa-b802-9bddd548821a service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-375e8c8e-3c2e-4a4c-ad3c-0d7bcd91896a req-263716ea-c84f-4afa-b802-9bddd548821a service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-375e8c8e-3c2e-4a4c-ad3c-0d7bcd91896a req-263716ea-c84f-4afa-b802-9bddd548821a service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-375e8c8e-3c2e-4a4c-ad3c-0d7bcd91896a req-263716ea-c84f-4afa-b802-9bddd548821a service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-375e8c8e-3c2e-4a4c-ad3c-0d7bcd91896a req-263716ea-c84f-4afa-b802-9bddd548821a service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:39 user nova-compute[74681]: WARNING nova.compute.manager [req-375e8c8e-3c2e-4a4c-ad3c-0d7bcd91896a req-263716ea-c84f-4afa-b802-9bddd548821a service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:28:39 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167319.8005235, 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:28:39 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] VM Started (Lifecycle Event)
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:28:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:28:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Starting finish_migration {{(pid=74681) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance directory exists: not creating {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 06:28:46 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Creating image(s)
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Ensure instance console log exists: /opt/stack/data/nova/instances/4cacaa1a-0734-4f8d-9e2a-f138bdd06553/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Start _get_guest_xml network_info=[{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1597326283-network", "vif_mac": "fa:16:3e:80:4b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'a7b58e77-55d8-4197-a1fd-89e9af2fdbb8', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwHWlah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4cacaa1a-0734-4f8d-9e2a-f138bdd06553', 'attached_at': '2023-08-16T06:28:46.000000', 'detached_at': '', 'volume_id': '665615ea-05d5-4978-b77e-5d3712fb916a', 'serial': '665615ea-05d5-4978-b77e-5d3712fb916a'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:28:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:28:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwHWlah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:28:46 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:28:46 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:28:46 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa36b892-5a05-465c-97ce-ae8b7a3a7083]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:28:46 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[257180c5-303e-4830-899d-7a8d50941806]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a] added
Aug 16 06:28:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6730540e-8a2e-4dba-8153-31e89aee1777]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd4e8d1-19e5-4224-8eda-194deeac9f3c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmwHWlah {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmwHWlah" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5b471-21f5-46ae-8ca0-2a3aee35c43b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmwHWlah'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e2ef13-2a64-42f1-8c22-418fa04e737c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167311.5163653, 6370394e-c0c1-40e2-9693-b5d5a333289d => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:28:46 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] VM Stopped (Lifecycle Event)
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[841c56a4-9934-4c12-83f7-8e1bf52dc437]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2220386a-45de-4078-9d7b-93282e86ef36 None None] [instance: 6370394e-c0c1-40e2-9693-b5d5a333289d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7969b8c-a658-4f10-a118-8a4dd9601308]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260]
Aug 16 06:28:46 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260] successful.
Aug 16 06:28:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eef730b-d604-42a3-9cf2-59095dbe5ffc]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba9c32e-1496-4be5-9cb0-1848861daaf3]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:28:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:28:46 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:28:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[04246712-8d4d-45a8-b1fe-966e3efd7d4e]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwHWlah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26531653532646362', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531653532646362', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1241571183',display_name='tempest-ServerActionsTestOtherA-server-1241571183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1241571183',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-5k4khnid',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:28:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=4cacaa1a-0734-4f8d-9e2a-f138bdd06553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1597326283-network", "vif_mac": "fa:16:3e:80:4b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1597326283-network", "vif_mac": "fa:16:3e:80:4b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:28:47 user nova-compute[74681]:   <uuid>4cacaa1a-0734-4f8d-9e2a-f138bdd06553</uuid>
Aug 16 06:28:47 user nova-compute[74681]:   <name>instance-00000026</name>
Aug 16 06:28:47 user nova-compute[74681]:   <memory>2097152</memory>
Aug 16 06:28:47 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:28:47 user nova-compute[74681]:   <metadata>
Aug 16 06:28:47 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:28:47 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:28:47 user nova-compute[74681]:       <nova:name>tempest-ServerActionsTestOtherA-server-1241571183</nova:name>
Aug 16 06:28:47 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:28:46</nova:creationTime>
Aug 16 06:28:47 user nova-compute[74681]:       <nova:flavor name="m1.small">
Aug 16 06:28:47 user nova-compute[74681]:         <nova:memory>2048</nova:memory>
Aug 16 06:28:47 user nova-compute[74681]:         <nova:disk>20</nova:disk>
Aug 16 06:28:47 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:28:47 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:28:47 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:28:47 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:28:47 user nova-compute[74681]:       <nova:owner>
Aug 16 06:28:47 user nova-compute[74681]:         <nova:user uuid="790c60ee58a549ddaabd5f0badcb77fe">tempest-ServerActionsTestOtherA-2037182259-project-member</nova:user>
Aug 16 06:28:47 user nova-compute[74681]:         <nova:project uuid="845526507c1a4a9eadc6c45271cceb94">tempest-ServerActionsTestOtherA-2037182259</nova:project>
Aug 16 06:28:47 user nova-compute[74681]:       </nova:owner>
Aug 16 06:28:47 user nova-compute[74681]:       <nova:ports>
Aug 16 06:28:47 user nova-compute[74681]:         <nova:port uuid="19c41113-5a63-4592-ac7b-88104f472bab">
Aug 16 06:28:47 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:28:47 user nova-compute[74681]:         </nova:port>
Aug 16 06:28:47 user nova-compute[74681]:       </nova:ports>
Aug 16 06:28:47 user nova-compute[74681]:     </nova:instance>
Aug 16 06:28:47 user nova-compute[74681]:   </metadata>
Aug 16 06:28:47 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:28:47 user nova-compute[74681]:     <system>
Aug 16 06:28:47 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:28:47 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:28:47 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:28:47 user nova-compute[74681]:       <entry name="serial">4cacaa1a-0734-4f8d-9e2a-f138bdd06553</entry>
Aug 16 06:28:47 user nova-compute[74681]:       <entry name="uuid">4cacaa1a-0734-4f8d-9e2a-f138bdd06553</entry>
Aug 16 06:28:47 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:28:47 user nova-compute[74681]:     </system>
Aug 16 06:28:47 user nova-compute[74681]:   </sysinfo>
Aug 16 06:28:47 user nova-compute[74681]:   <os>
Aug 16 06:28:47 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:28:47 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:28:47 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:28:47 user nova-compute[74681]:   </os>
Aug 16 06:28:47 user nova-compute[74681]:   <features>
Aug 16 06:28:47 user nova-compute[74681]:     <acpi/>
Aug 16 06:28:47 user nova-compute[74681]:     <apic/>
Aug 16 06:28:47 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:28:47 user nova-compute[74681]:   </features>
Aug 16 06:28:47 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:28:47 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:28:47 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:28:47 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:28:47 user nova-compute[74681]:   </clock>
Aug 16 06:28:47 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:28:47 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:28:47 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:28:47 user nova-compute[74681]:   </cpu>
Aug 16 06:28:47 user nova-compute[74681]:   <devices>
Aug 16 06:28:47 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:28:47 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:28:47 user nova-compute[74681]:       <source dev="/dev/sdd"/>
Aug 16 06:28:47 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:28:47 user nova-compute[74681]:       <serial>665615ea-05d5-4978-b77e-5d3712fb916a</serial>
Aug 16 06:28:47 user nova-compute[74681]:     </disk>
Aug 16 06:28:47 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:28:47 user nova-compute[74681]:       <mac address="fa:16:3e:80:4b:a4"/>
Aug 16 06:28:47 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:28:47 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:28:47 user nova-compute[74681]:       <target dev="tap19c41113-5a"/>
Aug 16 06:28:47 user nova-compute[74681]:     </interface>
Aug 16 06:28:47 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:28:47 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/4cacaa1a-0734-4f8d-9e2a-f138bdd06553/console.log" append="off"/>
Aug 16 06:28:47 user nova-compute[74681]:     </serial>
Aug 16 06:28:47 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:28:47 user nova-compute[74681]:     <video>
Aug 16 06:28:47 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:28:47 user nova-compute[74681]:     </video>
Aug 16 06:28:47 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:28:47 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:28:47 user nova-compute[74681]:     </rng>
Aug 16 06:28:47 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:28:47 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:28:47 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:28:47 user nova-compute[74681]:     </memballoon>
Aug 16 06:28:47 user nova-compute[74681]:   </devices>
Aug 16 06:28:47 user nova-compute[74681]: </domain>
Aug 16 06:28:47 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1241571183',display_name='tempest-ServerActionsTestOtherA-server-1241571183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1241571183',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:27:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-5k4khnid',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:28:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=4cacaa1a-0734-4f8d-9e2a-f138bdd06553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1597326283-network", "vif_mac": "fa:16:3e:80:4b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1597326283-network", "vif_mac": "fa:16:3e:80:4b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG os_vif [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19c41113-5a, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19c41113-5a, col_values=(('external_ids', {'iface-id': '19c41113-5a63-4592-ac7b-88104f472bab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:4b:a4', 'vm-uuid': '4cacaa1a-0734-4f8d-9e2a-f138bdd06553'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:47 user nova-compute[74681]: INFO os_vif [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a')
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:28:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] No VIF found with MAC fa:16:3e:80:4b:a4, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:28:48 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:48 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:48 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:28:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-7ff2760c-32a1-4b7c-a546-27659730f3a1 req-92bd9d2b-a4bb-4e6d-9452-1beccaafd19c service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ff2760c-32a1-4b7c-a546-27659730f3a1 req-92bd9d2b-a4bb-4e6d-9452-1beccaafd19c service nova] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ff2760c-32a1-4b7c-a546-27659730f3a1 req-92bd9d2b-a4bb-4e6d-9452-1beccaafd19c service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ff2760c-32a1-4b7c-a546-27659730f3a1 req-92bd9d2b-a4bb-4e6d-9452-1beccaafd19c service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-7ff2760c-32a1-4b7c-a546-27659730f3a1 req-92bd9d2b-a4bb-4e6d-9452-1beccaafd19c service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] No waiting events found dispatching network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:49 user nova-compute[74681]: WARNING nova.compute.manager [req-7ff2760c-32a1-4b7c-a546-27659730f3a1 req-92bd9d2b-a4bb-4e6d-9452-1beccaafd19c service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received unexpected event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab for instance with vm_state active and task_state resize_finish.
Aug 16 06:28:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167314.4058447, 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:28:49 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] VM Stopped (Lifecycle Event)
Aug 16 06:28:49 user nova-compute[74681]: DEBUG nova.compute.manager [None req-56020469-bb8c-4588-a976-eabb4d46b849 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167331.0861762, 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:28:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] VM Resumed (Lifecycle Event)
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:28:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance running successfully.
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Failed to set time: agent not configured {{(pid=74681) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-60259941-f976-4e8a-a3c7-df285416c77d tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] finish_migration finished successfully. {{(pid=74681) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167331.0987222, 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:28:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] VM Started (Lifecycle Event)
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:28:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-99bd1480-1e25-4574-b264-c6e104896852 req-cd8c942d-ba9c-4667-84f8-741cfcff129e service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-99bd1480-1e25-4574-b264-c6e104896852 req-cd8c942d-ba9c-4667-84f8-741cfcff129e service nova] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-99bd1480-1e25-4574-b264-c6e104896852 req-cd8c942d-ba9c-4667-84f8-741cfcff129e service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-99bd1480-1e25-4574-b264-c6e104896852 req-cd8c942d-ba9c-4667-84f8-741cfcff129e service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-99bd1480-1e25-4574-b264-c6e104896852 req-cd8c942d-ba9c-4667-84f8-741cfcff129e service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] No waiting events found dispatching network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:28:51 user nova-compute[74681]: WARNING nova.compute.manager [req-99bd1480-1e25-4574-b264-c6e104896852 req-cd8c942d-ba9c-4667-84f8-741cfcff129e service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received unexpected event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab for instance with vm_state active and task_state resize_finish.
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:28:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:28:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7497MB free_disk=25.122421264648438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Applying migration context for instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 as it has an incoming, in-progress migration da20cfa5-a09a-4256-b150-e799a412039d. Migration status is finished {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 06:28:53 user nova-compute[74681]: INFO nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating resource usage from migration da20cfa5-a09a-4256-b150-e799a412039d
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 195ea078-71f3-494a-ac7f-8c84992287b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Migration da20cfa5-a09a-4256-b150-e799a412039d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:28:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:28:54 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:28:54 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:28:54 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:28:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.834s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:28:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:28:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:28:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:28:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:28:55 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [{"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5fc4c990-cc82-410a-b3fc-f931aa20b9b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:28:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'flavor' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:28:57 user nova-compute[74681]: INFO nova.compute.manager [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Attaching volume b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 to /dev/vdb
Aug 16 06:28:57 user nova-compute[74681]: DEBUG os_brick.utils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c141f-dbc8-4e53-a3a4-5368a99979b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e2b174-aa8a-4ffb-8edb-007b05b2bde1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ac9d56-8d0a-4444-8ef5-5598e73697cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[736c5294-1831-4f56-ab38-8e4282e940dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:28:57 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:28:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[200e27fa-4a95-4a17-bbe8-c9c3edaec4fa]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG os_brick.utils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating existing volume attachment record: f2034385-0537-47fc-acd4-8bacbb293a73 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:28:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:29:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:03 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:29:03 user nova-compute[74681]: INFO nova.compute.claims [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Claim successful on node user
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:29:04 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.policy [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '361d070042c54dd59f7179619de1d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd289f0a66d5047b7b1be8ca5d969eaea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:29:04 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Creating image(s)
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "/opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "/opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk 1073741824" returned: 0 in 0.061s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Successfully created port: 86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Cannot resize image /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'migration_context' on Instance uuid 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Ensure instance console log exists: /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Successfully updated port: 86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquired lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d690469-8725-4aa6-8e0d-881cba76ea5e req-8b2a4e50-99e7-4265-9c22-39626e517924 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received event network-changed-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d690469-8725-4aa6-8e0d-881cba76ea5e req-8b2a4e50-99e7-4265-9c22-39626e517924 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Refreshing instance network info cache due to event network-changed-86b625c3-b20c-4749-b442-9a91d85c2ade. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d690469-8725-4aa6-8e0d-881cba76ea5e req-8b2a4e50-99e7-4265-9c22-39626e517924 service nova] Acquiring lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Updating instance_info_cache with network_info: [{"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Releasing lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Instance network_info: |[{"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d690469-8725-4aa6-8e0d-881cba76ea5e req-8b2a4e50-99e7-4265-9c22-39626e517924 service nova] Acquired lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d690469-8725-4aa6-8e0d-881cba76ea5e req-8b2a4e50-99e7-4265-9c22-39626e517924 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Refreshing network info cache for port 86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Start _get_guest_xml network_info=[{"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:29:06 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:06 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1482480214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1482480214',id=41,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-s8rqu929',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:29:04Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=0ab4ec2f-f645-48dc-aada-fb2ce145bd6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=86b625c3-b20c-4749-b442-9a91d85c2ade,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b625c3-b2') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.objects.instance [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:29:06 user nova-compute[74681]:   <uuid>0ab4ec2f-f645-48dc-aada-fb2ce145bd6f</uuid>
Aug 16 06:29:06 user nova-compute[74681]:   <name>instance-00000029</name>
Aug 16 06:29:06 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:29:06 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:29:06 user nova-compute[74681]:   <metadata>
Aug 16 06:29:06 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:29:06 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:29:06 user nova-compute[74681]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1482480214</nova:name>
Aug 16 06:29:06 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:29:06</nova:creationTime>
Aug 16 06:29:06 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:29:06 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:29:06 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:29:06 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:29:06 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:29:06 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:29:06 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:29:06 user nova-compute[74681]:       <nova:owner>
Aug 16 06:29:06 user nova-compute[74681]:         <nova:user uuid="361d070042c54dd59f7179619de1d1e9">tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member</nova:user>
Aug 16 06:29:06 user nova-compute[74681]:         <nova:project uuid="d289f0a66d5047b7b1be8ca5d969eaea">tempest-ServerBootFromVolumeStableRescueTest-2074839932</nova:project>
Aug 16 06:29:06 user nova-compute[74681]:       </nova:owner>
Aug 16 06:29:06 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:29:06 user nova-compute[74681]:       <nova:ports>
Aug 16 06:29:06 user nova-compute[74681]:         <nova:port uuid="86b625c3-b20c-4749-b442-9a91d85c2ade">
Aug 16 06:29:06 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 06:29:06 user nova-compute[74681]:         </nova:port>
Aug 16 06:29:06 user nova-compute[74681]:       </nova:ports>
Aug 16 06:29:06 user nova-compute[74681]:     </nova:instance>
Aug 16 06:29:06 user nova-compute[74681]:   </metadata>
Aug 16 06:29:06 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:29:06 user nova-compute[74681]:     <system>
Aug 16 06:29:06 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:29:06 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:29:06 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:29:06 user nova-compute[74681]:       <entry name="serial">0ab4ec2f-f645-48dc-aada-fb2ce145bd6f</entry>
Aug 16 06:29:06 user nova-compute[74681]:       <entry name="uuid">0ab4ec2f-f645-48dc-aada-fb2ce145bd6f</entry>
Aug 16 06:29:06 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:29:06 user nova-compute[74681]:     </system>
Aug 16 06:29:06 user nova-compute[74681]:   </sysinfo>
Aug 16 06:29:06 user nova-compute[74681]:   <os>
Aug 16 06:29:06 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:29:06 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:29:06 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:29:06 user nova-compute[74681]:   </os>
Aug 16 06:29:06 user nova-compute[74681]:   <features>
Aug 16 06:29:06 user nova-compute[74681]:     <acpi/>
Aug 16 06:29:06 user nova-compute[74681]:     <apic/>
Aug 16 06:29:06 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:29:06 user nova-compute[74681]:   </features>
Aug 16 06:29:06 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:29:06 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:29:06 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:29:06 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:29:06 user nova-compute[74681]:   </clock>
Aug 16 06:29:06 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:29:06 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:29:06 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:29:06 user nova-compute[74681]:   </cpu>
Aug 16 06:29:06 user nova-compute[74681]:   <devices>
Aug 16 06:29:06 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:29:06 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:29:06 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk"/>
Aug 16 06:29:06 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:29:06 user nova-compute[74681]:     </disk>
Aug 16 06:29:06 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:29:06 user nova-compute[74681]:       <mac address="fa:16:3e:d5:03:4e"/>
Aug 16 06:29:06 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:29:06 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:29:06 user nova-compute[74681]:       <target dev="tap86b625c3-b2"/>
Aug 16 06:29:06 user nova-compute[74681]:     </interface>
Aug 16 06:29:06 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:29:06 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/console.log" append="off"/>
Aug 16 06:29:06 user nova-compute[74681]:     </serial>
Aug 16 06:29:06 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:29:06 user nova-compute[74681]:     <video>
Aug 16 06:29:06 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:29:06 user nova-compute[74681]:     </video>
Aug 16 06:29:06 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:29:06 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:29:06 user nova-compute[74681]:     </rng>
Aug 16 06:29:06 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:29:06 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:29:06 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:29:06 user nova-compute[74681]:     </memballoon>
Aug 16 06:29:06 user nova-compute[74681]:   </devices>
Aug 16 06:29:06 user nova-compute[74681]: </domain>
Aug 16 06:29:06 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1482480214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1482480214',id=41,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-s8rqu929',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:29:04Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=0ab4ec2f-f645-48dc-aada-fb2ce145bd6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=86b625c3-b20c-4749-b442-9a91d85c2ade,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b625c3-b2') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG os_vif [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=86b625c3-b20c-4749-b442-9a91d85c2ade,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b625c3-b2') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86b625c3-b2, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86b625c3-b2, col_values=(('external_ids', {'iface-id': '86b625c3-b20c-4749-b442-9a91d85c2ade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:03:4e', 'vm-uuid': '0ab4ec2f-f645-48dc-aada-fb2ce145bd6f'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:06 user nova-compute[74681]: INFO os_vif [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=86b625c3-b20c-4749-b442-9a91d85c2ade,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b625c3-b2')
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No VIF found with MAC fa:16:3e:d5:03:4e, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d690469-8725-4aa6-8e0d-881cba76ea5e req-8b2a4e50-99e7-4265-9c22-39626e517924 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Updated VIF entry in instance network info cache for port 86b625c3-b20c-4749-b442-9a91d85c2ade. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-3d690469-8725-4aa6-8e0d-881cba76ea5e req-8b2a4e50-99e7-4265-9c22-39626e517924 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Updating instance_info_cache with network_info: [{"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d690469-8725-4aa6-8e0d-881cba76ea5e req-8b2a4e50-99e7-4265-9c22-39626e517924 service nova] Releasing lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdYvswbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:29:07 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:29:07 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:29:07 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8014a49e-19f5-4784-b9fb-ee3b72e92057]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:29:07 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c4be1-0509-4749-8257-7569e2572444]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1] added
Aug 16 06:29:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e909fc6c-20ac-4d9b-80b5-4591855ddcce]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ff592f-ca55-40f1-90e9-e757a19c436f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdYvswbx {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdYvswbx" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1433ff-efc1-4ec8-a805-c28db1c45366]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QdYvswbx'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3963655b-89ea-4f8a-bce6-198aaec9a611]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e952479-0014-46b4-9fc9-975a4e854fb0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed17098e-48ac-478f-bef1-4d36b628f137]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260]
Aug 16 06:29:07 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260] successful.
Aug 16 06:29:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b45aa7-ce32-418f-b816-67015b331f1c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a87fb-8f07-4035-9966-f21af0b3b4d6]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:07 user nova-compute[74681]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0484cdd3-6152-4bb6-8514-2c8294c86691]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdYvswbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-2cb89bd8-32ba-40d8-bf7d-cfff7eaee7c0 req-edafddb5-7539-4537-b3e3-1ed3ee3f1a3d service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received event network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2cb89bd8-32ba-40d8-bf7d-cfff7eaee7c0 req-edafddb5-7539-4537-b3e3-1ed3ee3f1a3d service nova] Acquiring lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2cb89bd8-32ba-40d8-bf7d-cfff7eaee7c0 req-edafddb5-7539-4537-b3e3-1ed3ee3f1a3d service nova] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2cb89bd8-32ba-40d8-bf7d-cfff7eaee7c0 req-edafddb5-7539-4537-b3e3-1ed3ee3f1a3d service nova] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-2cb89bd8-32ba-40d8-bf7d-cfff7eaee7c0 req-edafddb5-7539-4537-b3e3-1ed3ee3f1a3d service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] No waiting events found dispatching network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:07 user nova-compute[74681]: WARNING nova.compute.manager [req-2cb89bd8-32ba-40d8-bf7d-cfff7eaee7c0 req-edafddb5-7539-4537-b3e3-1ed3ee3f1a3d service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received unexpected event network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade for instance with vm_state building and task_state spawning.
Aug 16 06:29:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:29:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26633636237383739', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:29:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633636237383739', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:29:08 user nova-compute[74681]: DEBUG nova.objects.instance [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'flavor' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:29:08 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:29:08 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:29:08 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:29:08 user nova-compute[74681]:   <serial>b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1</serial>
Aug 16 06:29:08 user nova-compute[74681]: </disk>
Aug 16 06:29:08 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No VIF found with MAC fa:16:3e:8f:24:33, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26796e9e-0360-460e-b65d-a49650ce892e tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.992s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received event network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] Acquiring lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] No waiting events found dispatching network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:09 user nova-compute[74681]: WARNING nova.compute.manager [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received unexpected event network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade for instance with vm_state building and task_state spawning.
Aug 16 06:29:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received event network-changed-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Refreshing instance network info cache due to event network-changed-06c9048f-7189-4901-b674-14b4b86f6a1c. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] Acquiring lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] Acquired lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Refreshing network info cache for port 06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167350.105574, 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:10 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] VM Resumed (Lifecycle Event)
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:29:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Instance spawned successfully.
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:29:10 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167350.10678, 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:10 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] VM Started (Lifecycle Event)
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:29:10 user nova-compute[74681]: INFO nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:10 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:29:10 user nova-compute[74681]: INFO nova.compute.manager [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Took 6.69 seconds to build instance.
Aug 16 06:29:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-f93425f0-2eff-4331-adc0-66f897a12f4a tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.830s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.network.neutron [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Updated VIF entry in instance network info cache for port 06c9048f-7189-4901-b674-14b4b86f6a1c. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG nova.network.neutron [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Updating instance_info_cache with network_info: [{"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-80f537f1-fbee-450f-9dd4-46b29cf82c4f req-66acf059-454a-41c4-9828-ff63e30e78d4 service nova] Releasing lock "refresh_cache-195ea078-71f3-494a-ac7f-8c84992287b3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-f65fecbb-ba75-4983-96ad-12cb6b65d1cf req-7ccf155f-e4c8-40ad-814c-ce9e0c29f40a service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-f65fecbb-ba75-4983-96ad-12cb6b65d1cf req-7ccf155f-e4c8-40ad-814c-ce9e0c29f40a service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing instance network info cache due to event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:29:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f65fecbb-ba75-4983-96ad-12cb6b65d1cf req-7ccf155f-e4c8-40ad-814c-ce9e0c29f40a service nova] Acquiring lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f65fecbb-ba75-4983-96ad-12cb6b65d1cf req-7ccf155f-e4c8-40ad-814c-ce9e0c29f40a service nova] Acquired lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:21 user nova-compute[74681]: DEBUG nova.network.neutron [req-f65fecbb-ba75-4983-96ad-12cb6b65d1cf req-7ccf155f-e4c8-40ad-814c-ce9e0c29f40a service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:29:22 user nova-compute[74681]: INFO nova.compute.claims [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Claim successful on node user
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.network.neutron [req-f65fecbb-ba75-4983-96ad-12cb6b65d1cf req-7ccf155f-e4c8-40ad-814c-ce9e0c29f40a service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updated VIF entry in instance network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.network.neutron [req-f65fecbb-ba75-4983-96ad-12cb6b65d1cf req-7ccf155f-e4c8-40ad-814c-ce9e0c29f40a service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating instance_info_cache with network_info: [{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f65fecbb-ba75-4983-96ad-12cb6b65d1cf req-7ccf155f-e4c8-40ad-814c-ce9e0c29f40a service nova] Releasing lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:29:22 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:29:22 user nova-compute[74681]: INFO nova.virt.block_device [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Booting with volume snapshot 404c7695-badc-4a74-8d30-2a81b0836847 at /dev/vda
Aug 16 06:29:22 user nova-compute[74681]: DEBUG nova.policy [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd0444b91944ba5b2d1e3c852456964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbdfedd72a4b38aaa5acd93ac18163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:29:23 user nova-compute[74681]: DEBUG nova.compute.manager [req-66100182-7374-42fb-841f-5ed355b5eed9 req-a4613086-eb92-46b8-bc75-341aee33bf90 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:23 user nova-compute[74681]: DEBUG nova.compute.manager [req-66100182-7374-42fb-841f-5ed355b5eed9 req-a4613086-eb92-46b8-bc75-341aee33bf90 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing instance network info cache due to event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:29:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-66100182-7374-42fb-841f-5ed355b5eed9 req-a4613086-eb92-46b8-bc75-341aee33bf90 service nova] Acquiring lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-66100182-7374-42fb-841f-5ed355b5eed9 req-a4613086-eb92-46b8-bc75-341aee33bf90 service nova] Acquired lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-66100182-7374-42fb-841f-5ed355b5eed9 req-a4613086-eb92-46b8-bc75-341aee33bf90 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:29:23 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Successfully created port: 25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:29:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-66100182-7374-42fb-841f-5ed355b5eed9 req-a4613086-eb92-46b8-bc75-341aee33bf90 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updated VIF entry in instance network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:29:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-66100182-7374-42fb-841f-5ed355b5eed9 req-a4613086-eb92-46b8-bc75-341aee33bf90 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating instance_info_cache with network_info: [{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-66100182-7374-42fb-841f-5ed355b5eed9 req-a4613086-eb92-46b8-bc75-341aee33bf90 service nova] Releasing lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Successfully updated port: 25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:29:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquired lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:29:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-7ddefba7-75e7-43b3-9586-f5549b0a2676 req-2d273c10-b3e2-4534-bd2f-68930076f88b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received event network-changed-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-7ddefba7-75e7-43b3-9586-f5549b0a2676 req-2d273c10-b3e2-4534-bd2f-68930076f88b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Refreshing instance network info cache due to event network-changed-25d2f00b-53b1-4a58-a90b-5cb6eb93adba. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:29:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ddefba7-75e7-43b3-9586-f5549b0a2676 req-2d273c10-b3e2-4534-bd2f-68930076f88b service nova] Acquiring lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:25 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Updating instance_info_cache with network_info: [{"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Releasing lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Instance network_info: |[{"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ddefba7-75e7-43b3-9586-f5549b0a2676 req-2d273c10-b3e2-4534-bd2f-68930076f88b service nova] Acquired lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG nova.network.neutron [req-7ddefba7-75e7-43b3-9586-f5549b0a2676 req-2d273c10-b3e2-4534-bd2f-68930076f88b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Refreshing network info cache for port 25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG nova.network.neutron [req-7ddefba7-75e7-43b3-9586-f5549b0a2676 req-2d273c10-b3e2-4534-bd2f-68930076f88b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Updated VIF entry in instance network info cache for port 25d2f00b-53b1-4a58-a90b-5cb6eb93adba. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG nova.network.neutron [req-7ddefba7-75e7-43b3-9586-f5549b0a2676 req-2d273c10-b3e2-4534-bd2f-68930076f88b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Updating instance_info_cache with network_info: [{"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7ddefba7-75e7-43b3-9586-f5549b0a2676 req-2d273c10-b3e2-4534-bd2f-68930076f88b service nova] Releasing lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG os_brick.utils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1932f8-44cc-49c5-8e6f-54af626cdbee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d1cbd-5600-4c68-b966-32f0f6b7ea99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9f0af8-988c-44bb-9f71-72a57203fa98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24f9b6-edeb-416f-939a-1909d3d0172e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:29:28 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:29:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd908d6-2fd3-4838-8683-a537799760ba]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG os_brick.utils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:29:28 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Updating existing volume attachment record: c058fca8-8359-4251-b0f7-767ad87acfec {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:29:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:30 user nova-compute[74681]: INFO nova.compute.manager [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Rebooting instance
Aug 16 06:29:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquired lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:30 user nova-compute[74681]: DEBUG nova.network.neutron [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:29:30 user nova-compute[74681]: DEBUG nova.network.neutron [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating instance_info_cache with network_info: [{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Releasing lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-36d31abc-7469-4004-b34a-d3450868283f req-86953fcc-b389-427a-9f57-264d091b7695 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-unplugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-36d31abc-7469-4004-b34a-d3450868283f req-86953fcc-b389-427a-9f57-264d091b7695 service nova] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-36d31abc-7469-4004-b34a-d3450868283f req-86953fcc-b389-427a-9f57-264d091b7695 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-36d31abc-7469-4004-b34a-d3450868283f req-86953fcc-b389-427a-9f57-264d091b7695 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-36d31abc-7469-4004-b34a-d3450868283f req-86953fcc-b389-427a-9f57-264d091b7695 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] No waiting events found dispatching network-vif-unplugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:31 user nova-compute[74681]: WARNING nova.compute.manager [req-36d31abc-7469-4004-b34a-d3450868283f req-86953fcc-b389-427a-9f57-264d091b7695 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received unexpected event network-vif-unplugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Instance destroyed successfully.
Aug 16 06:29:31 user nova-compute[74681]: DEBUG nova.objects.instance [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'resources' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1861279471',display_name='tempest-TestMinimumBasicScenario-server-1861279471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1861279471',id=39,image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZyOSjET3GDAIpQC3+ps+9KTk+m6cZvrsP+bZo2Ue/deEESsJytdYN10l+nGGzLIIsfzGIU5bWUT7lqG7VEmzSe/dcAr81t4dxnHCV6jG3DB//xVoOGRHNLu5cH5OdnQ==',key_name='tempest-TestMinimumBasicScenario-1809299411',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:27:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-3im4rpgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:29:31Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=b8e4f0c3-d421-4612-9ffd-eb882fb72eed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG os_vif [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb76985e8-e8, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:31 user nova-compute[74681]: INFO os_vif [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8')
Aug 16 06:29:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdYvswbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:29:31 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:29:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:31 user nova-compute[74681]: INFO nova.compute.manager [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Terminating instance
Aug 16 06:29:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[298d974d-a50d-45b7-9746-466386a1afc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b67bba-6d3e-430b-aea4-1f67825e8906]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94842e0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1'): ({'sdf'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Removing single pathed devices sdf {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f067e3e6-9b4f-4636-bdd6-71f33df960ce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.034s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a18fb3-8fcb-48e8-9af6-fc3d521b574e]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flushing IO for device /dev/sdf {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d39c0-4def-4156-87f1-7cd6bd5d23f1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.074s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32196fb-6a27-4291-aee4-bbe110bd2bdc]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f9fb32-dca9-49fc-9e35-38b90e56cda9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c1c5e1-83f2-443a-b0eb-6cfd130570ca]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260]
Aug 16 06:29:32 user nova-compute[74681]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260] successful.
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eab3529-8921-4270-9f81-debdc6be75c5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] <== disconnect_volume: return (406ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-fde70403-d577-4ed2-8fde-0cf7ebfbb766 req-ebabdad9-8e86-41d2-9c0f-0407585980dd service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fde70403-d577-4ed2-8fde-0cf7ebfbb766 req-ebabdad9-8e86-41d2-9c0f-0407585980dd service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fde70403-d577-4ed2-8fde-0cf7ebfbb766 req-ebabdad9-8e86-41d2-9c0f-0407585980dd service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fde70403-d577-4ed2-8fde-0cf7ebfbb766 req-ebabdad9-8e86-41d2-9c0f-0407585980dd service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-fde70403-d577-4ed2-8fde-0cf7ebfbb766 req-ebabdad9-8e86-41d2-9c0f-0407585980dd service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-fde70403-d577-4ed2-8fde-0cf7ebfbb766 req-ebabdad9-8e86-41d2-9c0f-0407585980dd service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Start _get_guest_xml network_info=[{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b7e981af-6965-4a0f-a22d-19445e4d6bdb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': 'b7e981af-6965-4a0f-a22d-19445e4d6bdb'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'f2034385-0537-47fc-acd4-8bacbb293a73', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdYvswbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'b8e4f0c3-d421-4612-9ffd-eb882fb72eed', 'attached_at': '', 'detached_at': '', 'volume_id': 'b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1', 'serial': 'b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:29:32 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:32 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b7e981af-6965-4a0f-a22d-19445e4d6bdb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdYvswbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:29:32 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:29:32 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:29:32 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[805c1dd3-4286-41ba-a9de-0d591dc445bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:29:32 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f859325-318e-46cd-a975-f4ee46ddd032]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1] added
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c43f6d5-2f66-4d69-817a-a7c00a2e4339]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f90f29-913b-424e-9f22-681d2385c205]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdYvswbx {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdYvswbx" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4277e70f-9e7b-4545-9666-47f0b8eaf61b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QdYvswbx'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92155e4-1186-4c9b-9847-84c8e24fb4d7]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1300a1-1e83-4572-9d6a-47626ff23f53]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Instance destroyed successfully.
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'resources' on Instance uuid 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1103772826',display_name='tempest-AttachVolumeTestJSON-server-1103772826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1103772826',id=28,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJimUbPa25HhudpSu6YqlVJ8QXPdpf2oCp8p1Gc9j2nvI2pT/WyQbvy+ijUABan4uPc4eAEXOlo0xBr2qzHOoyH8uKuq9JGRTUxYPJvJjm8f/a6Gp3XC+dG/hxEVTzQqzA==',key_name='tempest-keypair-1655805278',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:19:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-ot0r1y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=6297f1b7-34ea-4481-8d21-ead2bf0b3d2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f2886dcc-dad5-4242-a05f-e88b51734354", "address": "fa:16:3e:c6:73:6f", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2886dcc-da", "ovs_interfaceid": "f2886dcc-dad5-4242-a05f-e88b51734354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_vif [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c620e77b-4f26-4507-ac1f-ea6beeabe12b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260]
Aug 16 06:29:32 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260] successful.
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2886dcc-da, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0e71bd-0dee-46c2-bf70-32fe3aa7046d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: INFO os_vif [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:73:6f,bridge_name='br-int',has_traffic_filtering=True,id=f2886dcc-dad5-4242-a05f-e88b51734354,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2886dcc-da')
Aug 16 06:29:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Deleting instance files /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a_del
Aug 16 06:29:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Deletion of /opt/stack/data/nova/instances/6297f1b7-34ea-4481-8d21-ead2bf0b3d2a_del complete
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[192fc442-c187-411c-9419-0394cd8db026]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:32 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.076s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3624acf8-5c0c-4c8d-9bee-4e2be379464e]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:29:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdYvswbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:29:33 user nova-compute[74681]: INFO nova.compute.manager [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 16 06:29:33 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-705c9551-1ee2-4cee-a30d-d7854c665538 req-3d43869e-d2c9-44ea-a0e2-7b9e8d824e36 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-705c9551-1ee2-4cee-a30d-d7854c665538 req-3d43869e-d2c9-44ea-a0e2-7b9e8d824e36 service nova] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-705c9551-1ee2-4cee-a30d-d7854c665538 req-3d43869e-d2c9-44ea-a0e2-7b9e8d824e36 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-705c9551-1ee2-4cee-a30d-d7854c665538 req-3d43869e-d2c9-44ea-a0e2-7b9e8d824e36 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-705c9551-1ee2-4cee-a30d-d7854c665538 req-3d43869e-d2c9-44ea-a0e2-7b9e8d824e36 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] No waiting events found dispatching network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:33 user nova-compute[74681]: WARNING nova.compute.manager [req-705c9551-1ee2-4cee-a30d-d7854c665538 req-3d43869e-d2c9-44ea-a0e2-7b9e8d824e36 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received unexpected event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 06:29:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26633636237383739', 'path': '/dev/sdf'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:29:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633636237383739', 'path': '/dev/sdf'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1861279471',display_name='tempest-TestMinimumBasicScenario-server-1861279471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1861279471',id=39,image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZyOSjET3GDAIpQC3+ps+9KTk+m6cZvrsP+bZo2Ue/deEESsJytdYN10l+nGGzLIIsfzGIU5bWUT7lqG7VEmzSe/dcAr81t4dxnHCV6jG3DB//xVoOGRHNLu5cH5OdnQ==',key_name='tempest-TestMinimumBasicScenario-1809299411',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:27:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-3im4rpgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:29:31Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=b8e4f0c3-d421-4612-9ffd-eb882fb72eed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.objects.instance [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'pci_devices' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:29:34 user nova-compute[74681]:   <uuid>b8e4f0c3-d421-4612-9ffd-eb882fb72eed</uuid>
Aug 16 06:29:34 user nova-compute[74681]:   <name>instance-00000027</name>
Aug 16 06:29:34 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:29:34 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:29:34 user nova-compute[74681]:   <metadata>
Aug 16 06:29:34 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:29:34 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:29:34 user nova-compute[74681]:       <nova:name>tempest-TestMinimumBasicScenario-server-1861279471</nova:name>
Aug 16 06:29:34 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:29:32</nova:creationTime>
Aug 16 06:29:34 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:29:34 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:29:34 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:29:34 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:29:34 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:29:34 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:29:34 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:29:34 user nova-compute[74681]:       <nova:owner>
Aug 16 06:29:34 user nova-compute[74681]:         <nova:user uuid="ffd09ff1adb847afae4d0dc786a661e7">tempest-TestMinimumBasicScenario-1506407050-project-member</nova:user>
Aug 16 06:29:34 user nova-compute[74681]:         <nova:project uuid="d51e79d8a3ec4a3b877a82b3863c5a10">tempest-TestMinimumBasicScenario-1506407050</nova:project>
Aug 16 06:29:34 user nova-compute[74681]:       </nova:owner>
Aug 16 06:29:34 user nova-compute[74681]:       <nova:root type="image" uuid="b7e981af-6965-4a0f-a22d-19445e4d6bdb"/>
Aug 16 06:29:34 user nova-compute[74681]:       <nova:ports>
Aug 16 06:29:34 user nova-compute[74681]:         <nova:port uuid="b76985e8-e864-4b67-acd4-638e9c3c7d78">
Aug 16 06:29:34 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 06:29:34 user nova-compute[74681]:         </nova:port>
Aug 16 06:29:34 user nova-compute[74681]:       </nova:ports>
Aug 16 06:29:34 user nova-compute[74681]:     </nova:instance>
Aug 16 06:29:34 user nova-compute[74681]:   </metadata>
Aug 16 06:29:34 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:29:34 user nova-compute[74681]:     <system>
Aug 16 06:29:34 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:29:34 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:29:34 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:29:34 user nova-compute[74681]:       <entry name="serial">b8e4f0c3-d421-4612-9ffd-eb882fb72eed</entry>
Aug 16 06:29:34 user nova-compute[74681]:       <entry name="uuid">b8e4f0c3-d421-4612-9ffd-eb882fb72eed</entry>
Aug 16 06:29:34 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:29:34 user nova-compute[74681]:     </system>
Aug 16 06:29:34 user nova-compute[74681]:   </sysinfo>
Aug 16 06:29:34 user nova-compute[74681]:   <os>
Aug 16 06:29:34 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:29:34 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:29:34 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:29:34 user nova-compute[74681]:   </os>
Aug 16 06:29:34 user nova-compute[74681]:   <features>
Aug 16 06:29:34 user nova-compute[74681]:     <acpi/>
Aug 16 06:29:34 user nova-compute[74681]:     <apic/>
Aug 16 06:29:34 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:29:34 user nova-compute[74681]:   </features>
Aug 16 06:29:34 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:29:34 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:29:34 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:29:34 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:29:34 user nova-compute[74681]:   </clock>
Aug 16 06:29:34 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:29:34 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:29:34 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:29:34 user nova-compute[74681]:   </cpu>
Aug 16 06:29:34 user nova-compute[74681]:   <devices>
Aug 16 06:29:34 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:29:34 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:29:34 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk"/>
Aug 16 06:29:34 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:29:34 user nova-compute[74681]:     </disk>
Aug 16 06:29:34 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:29:34 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:29:34 user nova-compute[74681]:       <source dev="/dev/sdf"/>
Aug 16 06:29:34 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:29:34 user nova-compute[74681]:       <serial>b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1</serial>
Aug 16 06:29:34 user nova-compute[74681]:     </disk>
Aug 16 06:29:34 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:29:34 user nova-compute[74681]:       <mac address="fa:16:3e:8f:24:33"/>
Aug 16 06:29:34 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:29:34 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:29:34 user nova-compute[74681]:       <target dev="tapb76985e8-e8"/>
Aug 16 06:29:34 user nova-compute[74681]:     </interface>
Aug 16 06:29:34 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:29:34 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/console.log" append="off"/>
Aug 16 06:29:34 user nova-compute[74681]:     </serial>
Aug 16 06:29:34 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:29:34 user nova-compute[74681]:     <video>
Aug 16 06:29:34 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:29:34 user nova-compute[74681]:     </video>
Aug 16 06:29:34 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:29:34 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:29:34 user nova-compute[74681]:     </rng>
Aug 16 06:29:34 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:29:34 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:29:34 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:29:34 user nova-compute[74681]:     </memballoon>
Aug 16 06:29:34 user nova-compute[74681]:   </devices>
Aug 16 06:29:34 user nova-compute[74681]: </domain>
Aug 16 06:29:34 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:34 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Took 1.38 seconds to deallocate network for instance.
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.objects.instance [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:34 user nova-compute[74681]: WARNING nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state active and task_state deleting.
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:34 user nova-compute[74681]: WARNING nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state active and task_state deleting.
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:34 user nova-compute[74681]: WARNING nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state active and task_state deleting.
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-unplugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Acquiring lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] No waiting events found dispatching network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:34 user nova-compute[74681]: WARNING nova.compute.manager [req-c2f597d9-1649-47cc-8bb7-9fa143b3b272 req-e6525ebd-16ae-43f6-bb8a-3a40793e7a06 service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received unexpected event network-vif-plugged-f2886dcc-dad5-4242-a05f-e88b51734354 for instance with vm_state active and task_state deleting.
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Cannot resize image /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.objects.instance [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'migration_context' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1861279471',display_name='tempest-TestMinimumBasicScenario-server-1861279471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1861279471',id=39,image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZyOSjET3GDAIpQC3+ps+9KTk+m6cZvrsP+bZo2Ue/deEESsJytdYN10l+nGGzLIIsfzGIU5bWUT7lqG7VEmzSe/dcAr81t4dxnHCV6jG3DB//xVoOGRHNLu5cH5OdnQ==',key_name='tempest-TestMinimumBasicScenario-1809299411',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:27:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-3im4rpgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:29:31Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=b8e4f0c3-d421-4612-9ffd-eb882fb72eed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG os_vif [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb76985e8-e8, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb76985e8-e8, col_values=(('external_ids', {'iface-id': 'b76985e8-e864-4b67-acd4-638e9c3c7d78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:24:33', 'vm-uuid': 'b8e4f0c3-d421-4612-9ffd-eb882fb72eed'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:34 user nova-compute[74681]: INFO os_vif [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8')
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:29:34 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:29:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:35 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Deleted allocations for instance 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a
Aug 16 06:29:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aee74eea-c456-4687-8473-bfc412aea01f tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "6297f1b7-34ea-4481-8d21-ead2bf0b3d2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.167s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-618d4dd4-ed09-4f9d-b1dd-a8e4f8c71ef6 req-50fc5d13-1287-44ac-a300-3c0b4fb04e9b service nova] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Received event network-vif-deleted-f2886dcc-dad5-4242-a05f-e88b51734354 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] No waiting events found dispatching network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:37 user nova-compute[74681]: WARNING nova.compute.manager [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received unexpected event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 06:29:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] No waiting events found dispatching network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:37 user nova-compute[74681]: WARNING nova.compute.manager [req-642c7c7c-57a3-460a-861c-d24186b82368 req-f4b33fec-b95b-4066-ba5a-0e0ffadf6686 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received unexpected event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 for instance with vm_state active and task_state reboot_started_hard.
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for b8e4f0c3-d421-4612-9ffd-eb882fb72eed due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167378.5017715, b8e4f0c3-d421-4612-9ffd-eb882fb72eed => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] VM Resumed (Lifecycle Event)
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:29:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Instance rebooted successfully.
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:29:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167378.5040894, b8e4f0c3-d421-4612-9ffd-eb882fb72eed => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] VM Started (Lifecycle Event)
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-308064ab-e2f1-44bc-9ef3-d9e497243f62 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.290s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:38 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:29:38 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Creating image(s)
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Ensure instance console log exists: /opt/stack/data/nova/instances/e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Start _get_guest_xml network_info=[{"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T06:29:11Z,direct_url=<?>,disk_format='qcow2',id=12dd5918-34c7-4463-b44d-b524aa2ff202,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-936684347',owner='3fbbdfedd72a4b38aaa5acd93ac18163',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T06:29:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'c058fca8-8359-4251-b0f7-767ad87acfec', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcsXNheD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b06b3699-ef79-49e5-8fc1-6738b4faaf46', 'serial': 'b06b3699-ef79-49e5-8fc1-6738b4faaf46'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:29:38 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:38 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T06:29:11Z,direct_url=<?>,disk_format='qcow2',id=12dd5918-34c7-4463-b44d-b524aa2ff202,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-936684347',owner='3fbbdfedd72a4b38aaa5acd93ac18163',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T06:29:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:29:38 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcsXNheD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:29:39 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:29:39 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:29:39 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d7e6f8-1af3-4421-bd6f-4cede97ee593]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:29:39 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e79e20-f280-4401-8fc2-2bd67d94518c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46] added
Aug 16 06:29:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d714b3-1224-41b8-8af3-55a3e799753f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a0a10-f33c-4092-bc5d-23ae1316739d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcsXNheD {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qcsXNheD" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2777fb-591d-453a-845e-84534257a39e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qcsXNheD'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1d97c-dbc1-44dd-95d4-7c939fb3a82c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d23eb50-3ac7-4406-88e6-c66f61e27263]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bddc79-cbfe-4ffd-84d6-8a8b98885571]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46, portal: 172.16.0.220,3260]
Aug 16 06:29:39 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46, portal: 172.16.0.220,3260] successful.
Aug 16 06:29:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecac3d28-8c92-4f08-87bf-f88069a6a2db]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[979a5d24-f766-481c-8f1e-c95347bcb190]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)
Aug 16 06:29:39 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] HCTL ('38', '-', '-', 0) found on session 44 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[76395cf5-fde1-44c1-89b4-be6c120ed256]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching for a device in session 44 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcsXNheD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:29:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26561306335316433', 'path': '/dev/sdg'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561306335316433', 'path': '/dev/sdg'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1315051491',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1315051491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1315051491',id=42,image_ref='12dd5918-34c7-4463-b44d-b524aa2ff202',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDEnteNBYgapSBs5INmLPiw5dPg3GW+7tISch58ldUNKruhj0IcPVO8Yw/u5W2zzbELd7yw0dRHrNECmdaJyymWaKicrEx+no5CHu4lev5U7ikE93KV8vEo16hhXBBTBw==',key_name='tempest-keypair-642351658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-607aslfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-702107063',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd0444b91944ba5b2d1e3c852456964',uuid=e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:30:37,bridge_name='br-int',has_traffic_filtering=True,id=25d2f00b-53b1-4a58-a90b-5cb6eb93adba,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d2f00b-53') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'pci_devices' on Instance uuid e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:29:40 user nova-compute[74681]:   <uuid>e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c</uuid>
Aug 16 06:29:40 user nova-compute[74681]:   <name>instance-0000002a</name>
Aug 16 06:29:40 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:29:40 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:29:40 user nova-compute[74681]:   <metadata>
Aug 16 06:29:40 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:29:40 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:29:40 user nova-compute[74681]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1315051491</nova:name>
Aug 16 06:29:40 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:29:38</nova:creationTime>
Aug 16 06:29:40 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:29:40 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:29:40 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:29:40 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:29:40 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:29:40 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:29:40 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:29:40 user nova-compute[74681]:       <nova:owner>
Aug 16 06:29:40 user nova-compute[74681]:         <nova:user uuid="efd0444b91944ba5b2d1e3c852456964">tempest-TestVolumeBootPattern-702107063-project-member</nova:user>
Aug 16 06:29:40 user nova-compute[74681]:         <nova:project uuid="3fbbdfedd72a4b38aaa5acd93ac18163">tempest-TestVolumeBootPattern-702107063</nova:project>
Aug 16 06:29:40 user nova-compute[74681]:       </nova:owner>
Aug 16 06:29:40 user nova-compute[74681]:       <nova:root type="image" uuid="12dd5918-34c7-4463-b44d-b524aa2ff202"/>
Aug 16 06:29:40 user nova-compute[74681]:       <nova:ports>
Aug 16 06:29:40 user nova-compute[74681]:         <nova:port uuid="25d2f00b-53b1-4a58-a90b-5cb6eb93adba">
Aug 16 06:29:40 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:29:40 user nova-compute[74681]:         </nova:port>
Aug 16 06:29:40 user nova-compute[74681]:       </nova:ports>
Aug 16 06:29:40 user nova-compute[74681]:     </nova:instance>
Aug 16 06:29:40 user nova-compute[74681]:   </metadata>
Aug 16 06:29:40 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:29:40 user nova-compute[74681]:     <system>
Aug 16 06:29:40 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:29:40 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:29:40 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:29:40 user nova-compute[74681]:       <entry name="serial">e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c</entry>
Aug 16 06:29:40 user nova-compute[74681]:       <entry name="uuid">e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c</entry>
Aug 16 06:29:40 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:29:40 user nova-compute[74681]:     </system>
Aug 16 06:29:40 user nova-compute[74681]:   </sysinfo>
Aug 16 06:29:40 user nova-compute[74681]:   <os>
Aug 16 06:29:40 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:29:40 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:29:40 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:29:40 user nova-compute[74681]:   </os>
Aug 16 06:29:40 user nova-compute[74681]:   <features>
Aug 16 06:29:40 user nova-compute[74681]:     <acpi/>
Aug 16 06:29:40 user nova-compute[74681]:     <apic/>
Aug 16 06:29:40 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:29:40 user nova-compute[74681]:   </features>
Aug 16 06:29:40 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:29:40 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:29:40 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:29:40 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:29:40 user nova-compute[74681]:   </clock>
Aug 16 06:29:40 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:29:40 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:29:40 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:29:40 user nova-compute[74681]:   </cpu>
Aug 16 06:29:40 user nova-compute[74681]:   <devices>
Aug 16 06:29:40 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:29:40 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:29:40 user nova-compute[74681]:       <source dev="/dev/sdg"/>
Aug 16 06:29:40 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:29:40 user nova-compute[74681]:       <serial>b06b3699-ef79-49e5-8fc1-6738b4faaf46</serial>
Aug 16 06:29:40 user nova-compute[74681]:     </disk>
Aug 16 06:29:40 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:29:40 user nova-compute[74681]:       <mac address="fa:16:3e:36:30:37"/>
Aug 16 06:29:40 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:29:40 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:29:40 user nova-compute[74681]:       <target dev="tap25d2f00b-53"/>
Aug 16 06:29:40 user nova-compute[74681]:     </interface>
Aug 16 06:29:40 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:29:40 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c/console.log" append="off"/>
Aug 16 06:29:40 user nova-compute[74681]:     </serial>
Aug 16 06:29:40 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:29:40 user nova-compute[74681]:     <video>
Aug 16 06:29:40 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:29:40 user nova-compute[74681]:     </video>
Aug 16 06:29:40 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:29:40 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:29:40 user nova-compute[74681]:     </rng>
Aug 16 06:29:40 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:29:40 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:29:40 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:29:40 user nova-compute[74681]:     </memballoon>
Aug 16 06:29:40 user nova-compute[74681]:   </devices>
Aug 16 06:29:40 user nova-compute[74681]: </domain>
Aug 16 06:29:40 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1315051491',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1315051491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1315051491',id=42,image_ref='12dd5918-34c7-4463-b44d-b524aa2ff202',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDEnteNBYgapSBs5INmLPiw5dPg3GW+7tISch58ldUNKruhj0IcPVO8Yw/u5W2zzbELd7yw0dRHrNECmdaJyymWaKicrEx+no5CHu4lev5U7ikE93KV8vEo16hhXBBTBw==',key_name='tempest-keypair-642351658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-607aslfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-702107063',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd0444b91944ba5b2d1e3c852456964',uuid=e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:30:37,bridge_name='br-int',has_traffic_filtering=True,id=25d2f00b-53b1-4a58-a90b-5cb6eb93adba,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d2f00b-53') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG os_vif [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:30:37,bridge_name='br-int',has_traffic_filtering=True,id=25d2f00b-53b1-4a58-a90b-5cb6eb93adba,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d2f00b-53') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25d2f00b-53, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25d2f00b-53, col_values=(('external_ids', {'iface-id': '25d2f00b-53b1-4a58-a90b-5cb6eb93adba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:30:37', 'vm-uuid': 'e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:40 user nova-compute[74681]: INFO os_vif [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:30:37,bridge_name='br-int',has_traffic_filtering=True,id=25d2f00b-53b1-4a58-a90b-5cb6eb93adba,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d2f00b-53')
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:29:40 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No VIF found with MAC fa:16:3e:36:30:37, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:29:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-78f815a5-272c-45b7-b23c-54e2a9e0680a req-1e901397-1ad7-446c-bce6-fb0a66057d6b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received event network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78f815a5-272c-45b7-b23c-54e2a9e0680a req-1e901397-1ad7-446c-bce6-fb0a66057d6b service nova] Acquiring lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78f815a5-272c-45b7-b23c-54e2a9e0680a req-1e901397-1ad7-446c-bce6-fb0a66057d6b service nova] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78f815a5-272c-45b7-b23c-54e2a9e0680a req-1e901397-1ad7-446c-bce6-fb0a66057d6b service nova] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:42 user nova-compute[74681]: DEBUG nova.compute.manager [req-78f815a5-272c-45b7-b23c-54e2a9e0680a req-1e901397-1ad7-446c-bce6-fb0a66057d6b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] No waiting events found dispatching network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:42 user nova-compute[74681]: WARNING nova.compute.manager [req-78f815a5-272c-45b7-b23c-54e2a9e0680a req-1e901397-1ad7-446c-bce6-fb0a66057d6b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received unexpected event network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba for instance with vm_state building and task_state spawning.
Aug 16 06:29:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-176fa028-e9aa-4568-b801-c4e1e8ec28a2 req-09bee823-696c-4d65-86a8-906c23fcb4f9 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received event network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-176fa028-e9aa-4568-b801-c4e1e8ec28a2 req-09bee823-696c-4d65-86a8-906c23fcb4f9 service nova] Acquiring lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-176fa028-e9aa-4568-b801-c4e1e8ec28a2 req-09bee823-696c-4d65-86a8-906c23fcb4f9 service nova] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-176fa028-e9aa-4568-b801-c4e1e8ec28a2 req-09bee823-696c-4d65-86a8-906c23fcb4f9 service nova] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.compute.manager [req-176fa028-e9aa-4568-b801-c4e1e8ec28a2 req-09bee823-696c-4d65-86a8-906c23fcb4f9 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] No waiting events found dispatching network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:44 user nova-compute[74681]: WARNING nova.compute.manager [req-176fa028-e9aa-4568-b801-c4e1e8ec28a2 req-09bee823-696c-4d65-86a8-906c23fcb4f9 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received unexpected event network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba for instance with vm_state building and task_state spawning.
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167384.1568098, e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:44 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] VM Resumed (Lifecycle Event)
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:29:44 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Instance spawned successfully.
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:29:44 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167384.1614933, e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:44 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] VM Started (Lifecycle Event)
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:29:44 user nova-compute[74681]: INFO nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Took 5.29 seconds to spawn the instance on the hypervisor.
Aug 16 06:29:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:44 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:29:44 user nova-compute[74681]: INFO nova.compute.manager [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Took 22.17 seconds to build instance.
Aug 16 06:29:44 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cc0e83c3-3f43-4fce-a160-4754b86457bc tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.294s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:46 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:47 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167372.7715003, 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:47 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] VM Stopped (Lifecycle Event)
Aug 16 06:29:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-196f85f9-81dd-4e74-8290-15a2a2608467 None None] [instance: 6297f1b7-34ea-4481-8d21-ead2bf0b3d2a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:52 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:52 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7281MB free_disk=25.116329193115234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Applying migration context for instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 as it has an incoming, in-progress migration da20cfa5-a09a-4256-b150-e799a412039d. Migration status is finished {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 06:29:52 user nova-compute[74681]: INFO nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating resource usage from migration da20cfa5-a09a-4256-b150-e799a412039d
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 195ea078-71f3-494a-ac7f-8c84992287b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Migration da20cfa5-a09a-4256-b150-e799a412039d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance c9200141-adb8-47a2-901b-a113086c89b7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.537s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:52 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:29:52 user nova-compute[74681]: INFO nova.compute.claims [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Claim successful on node user
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.network.neutron [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:29:53 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.policy [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '586e737fe78c4bf180d51f0470bd8648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ba755546fe440591b1292c5d74a8f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:29:53 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Creating image(s)
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "/opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "/opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:53 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk 1073741824" returned: 0 in 0.052s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.network.neutron [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Successfully created port: 061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Cannot resize image /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.objects.instance [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'migration_context' on Instance uuid c9200141-adb8-47a2-901b-a113086c89b7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Ensure instance console log exists: /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updating instance_info_cache with network_info: [{"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-6485c0f0-71dd-48f3-b2fe-449e1770cda7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Successfully updated port: 061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquired lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-f9c13159-ad97-4715-8f07-d195ba3e79af req-a3059778-7893-4dbc-b9e8-1d9449634593 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received event network-changed-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.compute.manager [req-f9c13159-ad97-4715-8f07-d195ba3e79af req-a3059778-7893-4dbc-b9e8-1d9449634593 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Refreshing instance network info cache due to event network-changed-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f9c13159-ad97-4715-8f07-d195ba3e79af req-a3059778-7893-4dbc-b9e8-1d9449634593 service nova] Acquiring lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Updating instance_info_cache with network_info: [{"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Releasing lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Instance network_info: |[{"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f9c13159-ad97-4715-8f07-d195ba3e79af req-a3059778-7893-4dbc-b9e8-1d9449634593 service nova] Acquired lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.neutron [req-f9c13159-ad97-4715-8f07-d195ba3e79af req-a3059778-7893-4dbc-b9e8-1d9449634593 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Refreshing network info cache for port 061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Start _get_guest_xml network_info=[{"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:29:55 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:55 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1865982331',display_name='tempest-VolumesSnapshotTestJSON-instance-1865982331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1865982331',id=43,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3q+UiznDz6jDiU1OWfrY/qMPlcIlf21PGJrOIYS0/8HIlGfamBRsTlKkJ7QxMILfIjlb+oIC7Jxx231gUA/za4X9bNRD7rg34xsLqUuKPt/z+8081r3CzoNmKbXIZdPQ==',key_name='tempest-keypair-1870662208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01ba755546fe440591b1292c5d74a8f2',ramdisk_id='',reservation_id='r-f0h25z6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-848952719',owner_user_name='tempest-VolumesSnapshotTestJSON-848952719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:29:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='586e737fe78c4bf180d51f0470bd8648',uuid=c9200141-adb8-47a2-901b-a113086c89b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converting VIF {"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:42:5a,bridge_name='br-int',has_traffic_filtering=True,id=061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061cd7ee-4e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.objects.instance [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'pci_devices' on Instance uuid c9200141-adb8-47a2-901b-a113086c89b7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:29:55 user nova-compute[74681]:   <uuid>c9200141-adb8-47a2-901b-a113086c89b7</uuid>
Aug 16 06:29:55 user nova-compute[74681]:   <name>instance-0000002b</name>
Aug 16 06:29:55 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:29:55 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:29:55 user nova-compute[74681]:   <metadata>
Aug 16 06:29:55 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:29:55 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:29:55 user nova-compute[74681]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1865982331</nova:name>
Aug 16 06:29:55 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:29:55</nova:creationTime>
Aug 16 06:29:55 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:29:55 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:29:55 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:29:55 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:29:55 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:29:55 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:29:55 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:29:55 user nova-compute[74681]:       <nova:owner>
Aug 16 06:29:55 user nova-compute[74681]:         <nova:user uuid="586e737fe78c4bf180d51f0470bd8648">tempest-VolumesSnapshotTestJSON-848952719-project-member</nova:user>
Aug 16 06:29:55 user nova-compute[74681]:         <nova:project uuid="01ba755546fe440591b1292c5d74a8f2">tempest-VolumesSnapshotTestJSON-848952719</nova:project>
Aug 16 06:29:55 user nova-compute[74681]:       </nova:owner>
Aug 16 06:29:55 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:29:55 user nova-compute[74681]:       <nova:ports>
Aug 16 06:29:55 user nova-compute[74681]:         <nova:port uuid="061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a">
Aug 16 06:29:55 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 06:29:55 user nova-compute[74681]:         </nova:port>
Aug 16 06:29:55 user nova-compute[74681]:       </nova:ports>
Aug 16 06:29:55 user nova-compute[74681]:     </nova:instance>
Aug 16 06:29:55 user nova-compute[74681]:   </metadata>
Aug 16 06:29:55 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:29:55 user nova-compute[74681]:     <system>
Aug 16 06:29:55 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:29:55 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:29:55 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:29:55 user nova-compute[74681]:       <entry name="serial">c9200141-adb8-47a2-901b-a113086c89b7</entry>
Aug 16 06:29:55 user nova-compute[74681]:       <entry name="uuid">c9200141-adb8-47a2-901b-a113086c89b7</entry>
Aug 16 06:29:55 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:29:55 user nova-compute[74681]:     </system>
Aug 16 06:29:55 user nova-compute[74681]:   </sysinfo>
Aug 16 06:29:55 user nova-compute[74681]:   <os>
Aug 16 06:29:55 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:29:55 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:29:55 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:29:55 user nova-compute[74681]:   </os>
Aug 16 06:29:55 user nova-compute[74681]:   <features>
Aug 16 06:29:55 user nova-compute[74681]:     <acpi/>
Aug 16 06:29:55 user nova-compute[74681]:     <apic/>
Aug 16 06:29:55 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:29:55 user nova-compute[74681]:   </features>
Aug 16 06:29:55 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:29:55 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:29:55 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:29:55 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:29:55 user nova-compute[74681]:   </clock>
Aug 16 06:29:55 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:29:55 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:29:55 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:29:55 user nova-compute[74681]:   </cpu>
Aug 16 06:29:55 user nova-compute[74681]:   <devices>
Aug 16 06:29:55 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:29:55 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:29:55 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk"/>
Aug 16 06:29:55 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:29:55 user nova-compute[74681]:     </disk>
Aug 16 06:29:55 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:29:55 user nova-compute[74681]:       <mac address="fa:16:3e:7d:42:5a"/>
Aug 16 06:29:55 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:29:55 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:29:55 user nova-compute[74681]:       <target dev="tap061cd7ee-4e"/>
Aug 16 06:29:55 user nova-compute[74681]:     </interface>
Aug 16 06:29:55 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:29:55 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/console.log" append="off"/>
Aug 16 06:29:55 user nova-compute[74681]:     </serial>
Aug 16 06:29:55 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:29:55 user nova-compute[74681]:     <video>
Aug 16 06:29:55 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:29:55 user nova-compute[74681]:     </video>
Aug 16 06:29:55 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:29:55 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:29:55 user nova-compute[74681]:     </rng>
Aug 16 06:29:55 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:29:55 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:29:55 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:29:55 user nova-compute[74681]:     </memballoon>
Aug 16 06:29:55 user nova-compute[74681]:   </devices>
Aug 16 06:29:55 user nova-compute[74681]: </domain>
Aug 16 06:29:55 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1865982331',display_name='tempest-VolumesSnapshotTestJSON-instance-1865982331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1865982331',id=43,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3q+UiznDz6jDiU1OWfrY/qMPlcIlf21PGJrOIYS0/8HIlGfamBRsTlKkJ7QxMILfIjlb+oIC7Jxx231gUA/za4X9bNRD7rg34xsLqUuKPt/z+8081r3CzoNmKbXIZdPQ==',key_name='tempest-keypair-1870662208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01ba755546fe440591b1292c5d74a8f2',ramdisk_id='',reservation_id='r-f0h25z6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-848952719',owner_user_name='tempest-VolumesSnapshotTestJSON-848952719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:29:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='586e737fe78c4bf180d51f0470bd8648',uuid=c9200141-adb8-47a2-901b-a113086c89b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converting VIF {"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:42:5a,bridge_name='br-int',has_traffic_filtering=True,id=061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061cd7ee-4e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG os_vif [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:42:5a,bridge_name='br-int',has_traffic_filtering=True,id=061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061cd7ee-4e') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap061cd7ee-4e, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap061cd7ee-4e, col_values=(('external_ids', {'iface-id': '061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:42:5a', 'vm-uuid': 'c9200141-adb8-47a2-901b-a113086c89b7'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:55 user nova-compute[74681]: INFO os_vif [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:42:5a,bridge_name='br-int',has_traffic_filtering=True,id=061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061cd7ee-4e')
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:29:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No VIF found with MAC fa:16:3e:7d:42:5a, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:29:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:29:56 user nova-compute[74681]: DEBUG nova.network.neutron [req-f9c13159-ad97-4715-8f07-d195ba3e79af req-a3059778-7893-4dbc-b9e8-1d9449634593 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Updated VIF entry in instance network info cache for port 061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:29:56 user nova-compute[74681]: DEBUG nova.network.neutron [req-f9c13159-ad97-4715-8f07-d195ba3e79af req-a3059778-7893-4dbc-b9e8-1d9449634593 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Updating instance_info_cache with network_info: [{"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:29:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f9c13159-ad97-4715-8f07-d195ba3e79af req-a3059778-7893-4dbc-b9e8-1d9449634593 service nova] Releasing lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:29:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-3fc16c65-c4b9-45aa-8554-50d3f350d79d req-33cad581-13f2-46d2-92cc-116745f7a7ff service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received event network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3fc16c65-c4b9-45aa-8554-50d3f350d79d req-33cad581-13f2-46d2-92cc-116745f7a7ff service nova] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3fc16c65-c4b9-45aa-8554-50d3f350d79d req-33cad581-13f2-46d2-92cc-116745f7a7ff service nova] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3fc16c65-c4b9-45aa-8554-50d3f350d79d req-33cad581-13f2-46d2-92cc-116745f7a7ff service nova] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-3fc16c65-c4b9-45aa-8554-50d3f350d79d req-33cad581-13f2-46d2-92cc-116745f7a7ff service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] No waiting events found dispatching network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:57 user nova-compute[74681]: WARNING nova.compute.manager [req-3fc16c65-c4b9-45aa-8554-50d3f350d79d req-33cad581-13f2-46d2-92cc-116745f7a7ff service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received unexpected event network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a for instance with vm_state building and task_state spawning.
Aug 16 06:29:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167399.3228629, c9200141-adb8-47a2-901b-a113086c89b7 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:59 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] VM Resumed (Lifecycle Event)
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:29:59 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Instance spawned successfully.
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:29:59 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167399.3241518, c9200141-adb8-47a2-901b-a113086c89b7 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:29:59 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] VM Started (Lifecycle Event)
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:29:59 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:29:59 user nova-compute[74681]: INFO nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-05dbca06-66b1-4e88-9e2b-1efb2cbc0733 req-490024bb-ab75-42c9-8790-a47e0a505c6a service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received event network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-05dbca06-66b1-4e88-9e2b-1efb2cbc0733 req-490024bb-ab75-42c9-8790-a47e0a505c6a service nova] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-05dbca06-66b1-4e88-9e2b-1efb2cbc0733 req-490024bb-ab75-42c9-8790-a47e0a505c6a service nova] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-05dbca06-66b1-4e88-9e2b-1efb2cbc0733 req-490024bb-ab75-42c9-8790-a47e0a505c6a service nova] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:29:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-05dbca06-66b1-4e88-9e2b-1efb2cbc0733 req-490024bb-ab75-42c9-8790-a47e0a505c6a service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] No waiting events found dispatching network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:29:59 user nova-compute[74681]: WARNING nova.compute.manager [req-05dbca06-66b1-4e88-9e2b-1efb2cbc0733 req-490024bb-ab75-42c9-8790-a47e0a505c6a service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received unexpected event network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a for instance with vm_state building and task_state spawning.
Aug 16 06:29:59 user nova-compute[74681]: INFO nova.compute.manager [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Took 7.23 seconds to build instance.
Aug 16 06:29:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c20b7d48-fd42-46dc-9f38-7f953146c956 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.327s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Going to confirm migration 2 {{(pid=74681) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 06:30:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:30:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquired lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:30:20 user nova-compute[74681]: DEBUG nova.network.neutron [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:30:20 user nova-compute[74681]: DEBUG nova.objects.instance [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'info_cache' on Instance uuid 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating instance_info_cache with network_info: [{"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Releasing lock "refresh_cache-4cacaa1a-0734-4f8d-9e2a-f138bdd06553" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG nova.objects.instance [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'migration_context' on Instance uuid 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:30:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.425s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:22 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Deleted allocation for migration da20cfa5-a09a-4256-b150-e799a412039d
Aug 16 06:30:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-57c883df-5bc4-4567-9731-b989c8a9cb17 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.563s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:25 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:30:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:25 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:30:25 user nova-compute[74681]: INFO nova.compute.claims [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Claim successful on node user
Aug 16 06:30:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:30:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.policy [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca629fd2ab8b4728a772af22f19f48e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50b9e6e8d18446baeb39b48b22aa64d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:30:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Creating image(s)
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "/opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "/opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk 1073741824" returned: 0 in 0.066s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Successfully created port: f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:30:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Cannot resize image /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'migration_context' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Ensure instance console log exists: /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-12ca2b0c-7fc1-43f2-9cbc-d58138fd2350 req-14542b39-4fec-4c9e-a118-90ccbbed72ac service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-changed-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-12ca2b0c-7fc1-43f2-9cbc-d58138fd2350 req-14542b39-4fec-4c9e-a118-90ccbbed72ac service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Refreshing instance network info cache due to event network-changed-97185598-923f-4338-a826-e8f18738d20e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-12ca2b0c-7fc1-43f2-9cbc-d58138fd2350 req-14542b39-4fec-4c9e-a118-90ccbbed72ac service nova] Acquiring lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-12ca2b0c-7fc1-43f2-9cbc-d58138fd2350 req-14542b39-4fec-4c9e-a118-90ccbbed72ac service nova] Acquired lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-12ca2b0c-7fc1-43f2-9cbc-d58138fd2350 req-14542b39-4fec-4c9e-a118-90ccbbed72ac service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Refreshing network info cache for port 97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:27 user nova-compute[74681]: INFO nova.compute.manager [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Detaching volume f500c7ec-57df-4365-bb11-4651c2ea2f3e
Aug 16 06:30:27 user nova-compute[74681]: INFO nova.virt.block_device [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Attempting to driver detach volume f500c7ec-57df-4365-bb11-4651c2ea2f3e from mountpoint /dev/vdb
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Attempting to detach device vdb from instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:30:27 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:30:27 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:30:27 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:30:27 user nova-compute[74681]:   <serial>f500c7ec-57df-4365-bb11-4651c2ea2f3e</serial>
Aug 16 06:30:27 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:30:27 user nova-compute[74681]: </disk>
Aug 16 06:30:27 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:30:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Successfully detached device vdb from instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 from the persistent domain config.
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:30:27 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:30:27 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:30:27 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:30:27 user nova-compute[74681]:   <serial>f500c7ec-57df-4365-bb11-4651c2ea2f3e</serial>
Aug 16 06:30:27 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:30:27 user nova-compute[74681]: </disk>
Aug 16 06:30:27 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Successfully updated port: f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquired lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:30:27 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-0c964f76-0c18-498f-8323-284071aef3d3 req-d7f61e8c-fb7e-46db-ab76-6e1d3cf008c4 service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received event network-changed-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-0c964f76-0c18-498f-8323-284071aef3d3 req-d7f61e8c-fb7e-46db-ab76-6e1d3cf008c4 service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Refreshing instance network info cache due to event network-changed-f06da1d6-d714-4eb6-8ce2-935e2d120d7e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0c964f76-0c18-498f-8323-284071aef3d3 req-d7f61e8c-fb7e-46db-ab76-6e1d3cf008c4 service nova] Acquiring lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-12ca2b0c-7fc1-43f2-9cbc-d58138fd2350 req-14542b39-4fec-4c9e-a118-90ccbbed72ac service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updated VIF entry in instance network info cache for port 97185598-923f-4338-a826-e8f18738d20e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-12ca2b0c-7fc1-43f2-9cbc-d58138fd2350 req-14542b39-4fec-4c9e-a118-90ccbbed72ac service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating instance_info_cache with network_info: [{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-12ca2b0c-7fc1-43f2-9cbc-d58138fd2350 req-14542b39-4fec-4c9e-a118-90ccbbed72ac service nova] Releasing lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167428.3010116, 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:30:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Successfully detached device vdb from instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 from the live domain config.
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkKmGnAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:30:28 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb68c321-b814-43c0-ab96-b1b9b43c7f1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Updating instance_info_cache with network_info: [{"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd56298-b55b-4015-9a43-b5169d5f6d22]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)
Aug 16 06:30:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:30:28 user nova-compute[74681]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)
Aug 16 06:30:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94842e2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Releasing lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Instance network_info: |[{"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0c964f76-0c18-498f-8323-284071aef3d3 req-d7f61e8c-fb7e-46db-ab76-6e1d3cf008c4 service nova] Acquired lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-0c964f76-0c18-498f-8323-284071aef3d3 req-d7f61e8c-fb7e-46db-ab76-6e1d3cf008c4 service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Refreshing network info cache for port f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Start _get_guest_xml network_info=[{"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:30:28 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:30:28 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[359ecb14-2c1f-495b-87a3-017f452831bb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518048882',display_name='tempest-AttachVolumeTestJSON-server-1518048882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518048882',id=44,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyc7eKlzDG5fh1v2rYtxYBQvZc7BwTgoC8aYQzUZec4nIa0nPRlgS+ZQAzZAe5hSGDhn8I4Huw8BBcCXh4V3wKUdiDz/PNcSjDI/D+0usWiEfkzwDRRonlfchvOGmk4mg==',key_name='tempest-keypair-1082346996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-hnw9p0j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=3d65cb82-0f27-4fe5-9723-b620748548c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:e6,bridge_name='br-int',has_traffic_filtering=True,id=f06da1d6-d714-4eb6-8ce2-935e2d120d7e,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06da1d6-d7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f389684b-6d1f-4512-a9be-079428649a43]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:30:28 user nova-compute[74681]:   <uuid>3d65cb82-0f27-4fe5-9723-b620748548c1</uuid>
Aug 16 06:30:28 user nova-compute[74681]:   <name>instance-0000002c</name>
Aug 16 06:30:28 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:30:28 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:30:28 user nova-compute[74681]:   <metadata>
Aug 16 06:30:28 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:30:28 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:30:28 user nova-compute[74681]:       <nova:name>tempest-AttachVolumeTestJSON-server-1518048882</nova:name>
Aug 16 06:30:28 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:30:28</nova:creationTime>
Aug 16 06:30:28 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:30:28 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:30:28 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:30:28 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:30:28 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:30:28 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:30:28 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:30:28 user nova-compute[74681]:       <nova:owner>
Aug 16 06:30:28 user nova-compute[74681]:         <nova:user uuid="ca629fd2ab8b4728a772af22f19f48e1">tempest-AttachVolumeTestJSON-436096878-project-member</nova:user>
Aug 16 06:30:28 user nova-compute[74681]:         <nova:project uuid="d50b9e6e8d18446baeb39b48b22aa64d">tempest-AttachVolumeTestJSON-436096878</nova:project>
Aug 16 06:30:28 user nova-compute[74681]:       </nova:owner>
Aug 16 06:30:28 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:30:28 user nova-compute[74681]:       <nova:ports>
Aug 16 06:30:28 user nova-compute[74681]:         <nova:port uuid="f06da1d6-d714-4eb6-8ce2-935e2d120d7e">
Aug 16 06:30:28 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 06:30:28 user nova-compute[74681]:         </nova:port>
Aug 16 06:30:28 user nova-compute[74681]:       </nova:ports>
Aug 16 06:30:28 user nova-compute[74681]:     </nova:instance>
Aug 16 06:30:28 user nova-compute[74681]:   </metadata>
Aug 16 06:30:28 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:30:28 user nova-compute[74681]:     <system>
Aug 16 06:30:28 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:30:28 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:30:28 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:30:28 user nova-compute[74681]:       <entry name="serial">3d65cb82-0f27-4fe5-9723-b620748548c1</entry>
Aug 16 06:30:28 user nova-compute[74681]:       <entry name="uuid">3d65cb82-0f27-4fe5-9723-b620748548c1</entry>
Aug 16 06:30:28 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:30:28 user nova-compute[74681]:     </system>
Aug 16 06:30:28 user nova-compute[74681]:   </sysinfo>
Aug 16 06:30:28 user nova-compute[74681]:   <os>
Aug 16 06:30:28 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:30:28 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:30:28 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:30:28 user nova-compute[74681]:   </os>
Aug 16 06:30:28 user nova-compute[74681]:   <features>
Aug 16 06:30:28 user nova-compute[74681]:     <acpi/>
Aug 16 06:30:28 user nova-compute[74681]:     <apic/>
Aug 16 06:30:28 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:30:28 user nova-compute[74681]:   </features>
Aug 16 06:30:28 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:30:28 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:30:28 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:30:28 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:30:28 user nova-compute[74681]:   </clock>
Aug 16 06:30:28 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:30:28 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:30:28 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:30:28 user nova-compute[74681]:   </cpu>
Aug 16 06:30:28 user nova-compute[74681]:   <devices>
Aug 16 06:30:28 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:30:28 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:30:28 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk"/>
Aug 16 06:30:28 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:30:28 user nova-compute[74681]:     </disk>
Aug 16 06:30:28 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:30:28 user nova-compute[74681]:       <mac address="fa:16:3e:04:e8:e6"/>
Aug 16 06:30:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:30:28 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:30:28 user nova-compute[74681]:       <target dev="tapf06da1d6-d7"/>
Aug 16 06:30:28 user nova-compute[74681]:     </interface>
Aug 16 06:30:28 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:30:28 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/console.log" append="off"/>
Aug 16 06:30:28 user nova-compute[74681]:     </serial>
Aug 16 06:30:28 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:30:28 user nova-compute[74681]:     <video>
Aug 16 06:30:28 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:30:28 user nova-compute[74681]:     </video>
Aug 16 06:30:28 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:30:28 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:30:28 user nova-compute[74681]:     </rng>
Aug 16 06:30:28 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:30:28 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:30:28 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:30:28 user nova-compute[74681]:     </memballoon>
Aug 16 06:30:28 user nova-compute[74681]:   </devices>
Aug 16 06:30:28 user nova-compute[74681]: </domain>
Aug 16 06:30:28 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518048882',display_name='tempest-AttachVolumeTestJSON-server-1518048882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518048882',id=44,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyc7eKlzDG5fh1v2rYtxYBQvZc7BwTgoC8aYQzUZec4nIa0nPRlgS+ZQAzZAe5hSGDhn8I4Huw8BBcCXh4V3wKUdiDz/PNcSjDI/D+0usWiEfkzwDRRonlfchvOGmk4mg==',key_name='tempest-keypair-1082346996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-hnw9p0j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=3d65cb82-0f27-4fe5-9723-b620748548c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:e6,bridge_name='br-int',has_traffic_filtering=True,id=f06da1d6-d714-4eb6-8ce2-935e2d120d7e,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06da1d6-d7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_vif [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:e6,bridge_name='br-int',has_traffic_filtering=True,id=f06da1d6-d714-4eb6-8ce2-935e2d120d7e,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06da1d6-d7') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[da769470-308c-4cc0-9547-f7d8085bf726]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf06da1d6-d7, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf06da1d6-d7, col_values=(('external_ids', {'iface-id': 'f06da1d6-d714-4eb6-8ce2-935e2d120d7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:e8:e6', 'vm-uuid': '3d65cb82-0f27-4fe5-9723-b620748548c1'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:28 user nova-compute[74681]: INFO os_vif [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:e6,bridge_name='br-int',has_traffic_filtering=True,id=f06da1d6-d714-4eb6-8ce2-935e2d120d7e,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06da1d6-d7')
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55ad84e-528c-480c-81a4-583458d46dbd]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No VIF found with MAC fa:16:3e:04:e8:e6, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8734e75-7181-4e3f-aea7-a1a4ea58ebae]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6188b301-554c-4eef-b56f-0a0d11d282c7]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e, portal: 172.16.0.220,3260]
Aug 16 06:30:28 user nova-compute[74681]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e, portal: 172.16.0.220,3260] successful.
Aug 16 06:30:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f500c7ec-57df-4365-bb11-4651c2ea2f3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f4b0b8-b1fe-4fe9-809d-d5974c31780e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] <== disconnect_volume: return (353ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-0c964f76-0c18-498f-8323-284071aef3d3 req-d7f61e8c-fb7e-46db-ab76-6e1d3cf008c4 service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Updated VIF entry in instance network info cache for port f06da1d6-d714-4eb6-8ce2-935e2d120d7e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-0c964f76-0c18-498f-8323-284071aef3d3 req-d7f61e8c-fb7e-46db-ab76-6e1d3cf008c4 service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Updating instance_info_cache with network_info: [{"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:30:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0c964f76-0c18-498f-8323-284071aef3d3 req-d7f61e8c-fb7e-46db-ab76-6e1d3cf008c4 service nova] Releasing lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-136fd7ee-5ba9-4c68-b752-3278cca5725e req-178da8a6-d6e9-4cb2-8cc6-09f797d91480 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-changed-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-136fd7ee-5ba9-4c68-b752-3278cca5725e req-178da8a6-d6e9-4cb2-8cc6-09f797d91480 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Refreshing instance network info cache due to event network-changed-97185598-923f-4338-a826-e8f18738d20e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-136fd7ee-5ba9-4c68-b752-3278cca5725e req-178da8a6-d6e9-4cb2-8cc6-09f797d91480 service nova] Acquiring lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-136fd7ee-5ba9-4c68-b752-3278cca5725e req-178da8a6-d6e9-4cb2-8cc6-09f797d91480 service nova] Acquired lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-136fd7ee-5ba9-4c68-b752-3278cca5725e req-178da8a6-d6e9-4cb2-8cc6-09f797d91480 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Refreshing network info cache for port 97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG nova.objects.instance [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'flavor' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-361913c3-31cb-428f-9093-924eee6102a3 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.765s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-136fd7ee-5ba9-4c68-b752-3278cca5725e req-178da8a6-d6e9-4cb2-8cc6-09f797d91480 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updated VIF entry in instance network info cache for port 97185598-923f-4338-a826-e8f18738d20e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-136fd7ee-5ba9-4c68-b752-3278cca5725e req-178da8a6-d6e9-4cb2-8cc6-09f797d91480 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating instance_info_cache with network_info: [{"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-136fd7ee-5ba9-4c68-b752-3278cca5725e req-178da8a6-d6e9-4cb2-8cc6-09f797d91480 service nova] Releasing lock "refresh_cache-7998966b-a074-4d79-bf3f-9c5b9fbc60a9" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:30:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-9ff47fff-e524-4a0c-87f8-9fbd2108c401 req-a85270c8-70ee-4ea8-8b55-695b9738bf2a service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received event network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:30:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9ff47fff-e524-4a0c-87f8-9fbd2108c401 req-a85270c8-70ee-4ea8-8b55-695b9738bf2a service nova] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9ff47fff-e524-4a0c-87f8-9fbd2108c401 req-a85270c8-70ee-4ea8-8b55-695b9738bf2a service nova] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-9ff47fff-e524-4a0c-87f8-9fbd2108c401 req-a85270c8-70ee-4ea8-8b55-695b9738bf2a service nova] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-9ff47fff-e524-4a0c-87f8-9fbd2108c401 req-a85270c8-70ee-4ea8-8b55-695b9738bf2a service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] No waiting events found dispatching network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:30:30 user nova-compute[74681]: WARNING nova.compute.manager [req-9ff47fff-e524-4a0c-87f8-9fbd2108c401 req-a85270c8-70ee-4ea8-8b55-695b9738bf2a service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received unexpected event network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e for instance with vm_state building and task_state spawning.
Aug 16 06:30:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167431.897015, 3d65cb82-0f27-4fe5-9723-b620748548c1 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:30:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] VM Resumed (Lifecycle Event)
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:30:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Instance spawned successfully.
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:30:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167431.897381, 3d65cb82-0f27-4fe5-9723-b620748548c1 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:30:31 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] VM Started (Lifecycle Event)
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:30:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:30:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:30:32 user nova-compute[74681]: INFO nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 16 06:30:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:30:32 user nova-compute[74681]: INFO nova.compute.manager [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Took 6.48 seconds to build instance.
Aug 16 06:30:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-605f0b56-2eff-4819-b4e1-9def33e17df8 req-fba9471b-2c16-401b-9584-bf9b97dc17ed service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received event network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:30:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-605f0b56-2eff-4819-b4e1-9def33e17df8 req-fba9471b-2c16-401b-9584-bf9b97dc17ed service nova] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-605f0b56-2eff-4819-b4e1-9def33e17df8 req-fba9471b-2c16-401b-9584-bf9b97dc17ed service nova] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-605f0b56-2eff-4819-b4e1-9def33e17df8 req-fba9471b-2c16-401b-9584-bf9b97dc17ed service nova] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-605f0b56-2eff-4819-b4e1-9def33e17df8 req-fba9471b-2c16-401b-9584-bf9b97dc17ed service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] No waiting events found dispatching network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:30:32 user nova-compute[74681]: WARNING nova.compute.manager [req-605f0b56-2eff-4819-b4e1-9def33e17df8 req-fba9471b-2c16-401b-9584-bf9b97dc17ed service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received unexpected event network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e for instance with vm_state active and task_state None.
Aug 16 06:30:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8fec4b64-92b7-49f1-9cd3-eb78b9071aa5 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.648s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:30:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:30:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:30:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:30:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:30:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=6956MB free_disk=25.04281234741211GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 195ea078-71f3-494a-ac7f-8c84992287b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance c9200141-adb8-47a2-901b-a113086c89b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3d65cb82-0f27-4fe5-9723-b620748548c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing inventories for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating ProviderTree inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing aggregate associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, aggregates: None {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 06:30:53 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing trait associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 06:30:54 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:30:54 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:30:54 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:30:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.755s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:30:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:30:54 user nova-compute[74681]: INFO nova.compute.manager [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] instance snapshotting
Aug 16 06:30:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Beginning live snapshot process
Aug 16 06:30:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json -f qcow2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json -f qcow2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.172s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsnnvsp25/71884b1a9cf04240b017d09dc71938f2.delta 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsnnvsp25/71884b1a9cf04240b017d09dc71938f2.delta 1073741824" returned: 0 in 0.070s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:55 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 06:30:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74681) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 06:30:56 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 06:30:56 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:30:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsnnvsp25/71884b1a9cf04240b017d09dc71938f2.delta /opt/stack/data/nova/instances/snapshots/tmpsnnvsp25/71884b1a9cf04240b017d09dc71938f2 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updating instance_info_cache with network_info: [{"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5e675215-481e-4a14-955a-d92d43671e1a" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:30:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsnnvsp25/71884b1a9cf04240b017d09dc71938f2.delta /opt/stack/data/nova/instances/snapshots/tmpsnnvsp25/71884b1a9cf04240b017d09dc71938f2" returned: 0 in 0.688s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:30:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Snapshot extracted, beginning image upload
Aug 16 06:30:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:30:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:30:59 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Snapshot image upload complete
Aug 16 06:30:59 user nova-compute[74681]: INFO nova.compute.manager [None req-26b9e713-9197-4141-827a-7bd42a0ee4e7 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Took 5.04 seconds to snapshot the instance on the hypervisor.
Aug 16 06:31:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 06:31:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] There are 1 instances to clean {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 06:31:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance has had 3 of 5 cleanup attempts {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11142}}
Aug 16 06:31:00 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Deletion of /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize failed
Aug 16 06:31:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:08 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:08 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74681) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 06:31:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:31:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-e899214b-f818-40a5-bceb-76004403b19a req-7f4d8884-7293-4940-909a-bb886917074b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received event network-changed-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-e899214b-f818-40a5-bceb-76004403b19a req-7f4d8884-7293-4940-909a-bb886917074b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Refreshing instance network info cache due to event network-changed-25d2f00b-53b1-4a58-a90b-5cb6eb93adba. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:31:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e899214b-f818-40a5-bceb-76004403b19a req-7f4d8884-7293-4940-909a-bb886917074b service nova] Acquiring lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:31:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e899214b-f818-40a5-bceb-76004403b19a req-7f4d8884-7293-4940-909a-bb886917074b service nova] Acquired lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:31:13 user nova-compute[74681]: DEBUG nova.network.neutron [req-e899214b-f818-40a5-bceb-76004403b19a req-7f4d8884-7293-4940-909a-bb886917074b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Refreshing network info cache for port 25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:31:14 user nova-compute[74681]: DEBUG nova.network.neutron [req-e899214b-f818-40a5-bceb-76004403b19a req-7f4d8884-7293-4940-909a-bb886917074b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Updated VIF entry in instance network info cache for port 25d2f00b-53b1-4a58-a90b-5cb6eb93adba. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:31:14 user nova-compute[74681]: DEBUG nova.network.neutron [req-e899214b-f818-40a5-bceb-76004403b19a req-7f4d8884-7293-4940-909a-bb886917074b service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Updating instance_info_cache with network_info: [{"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:31:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e899214b-f818-40a5-bceb-76004403b19a req-7f4d8884-7293-4940-909a-bb886917074b service nova] Releasing lock "refresh_cache-e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:15 user nova-compute[74681]: INFO nova.compute.manager [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Terminating instance
Aug 16 06:31:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received event network-vif-unplugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] Acquiring lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] No waiting events found dispatching network-vif-unplugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received event network-vif-unplugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received event network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] Acquiring lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] No waiting events found dispatching network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:31:15 user nova-compute[74681]: WARNING nova.compute.manager [req-3d4ab592-e194-493e-9bc9-ec9081fcafa9 req-de1d775f-7d76-4f02-bbd8-87d7056117b1 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received unexpected event network-vif-plugged-25d2f00b-53b1-4a58-a90b-5cb6eb93adba for instance with vm_state active and task_state deleting.
Aug 16 06:31:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Instance destroyed successfully.
Aug 16 06:31:16 user nova-compute[74681]: DEBUG nova.objects.instance [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'resources' on Instance uuid e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1315051491',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1315051491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1315051491',id=42,image_ref='12dd5918-34c7-4463-b44d-b524aa2ff202',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDEnteNBYgapSBs5INmLPiw5dPg3GW+7tISch58ldUNKruhj0IcPVO8Yw/u5W2zzbELd7yw0dRHrNECmdaJyymWaKicrEx+no5CHu4lev5U7ikE93KV8vEo16hhXBBTBw==',key_name='tempest-keypair-642351658',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-607aslfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-702107063',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:29:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd0444b91944ba5b2d1e3c852456964',uuid=e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "address": "fa:16:3e:36:30:37", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d2f00b-53", "ovs_interfaceid": "25d2f00b-53b1-4a58-a90b-5cb6eb93adba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:30:37,bridge_name='br-int',has_traffic_filtering=True,id=25d2f00b-53b1-4a58-a90b-5cb6eb93adba,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d2f00b-53') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_vif [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:30:37,bridge_name='br-int',has_traffic_filtering=True,id=25d2f00b-53b1-4a58-a90b-5cb6eb93adba,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d2f00b-53') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25d2f00b-53, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:31:16 user nova-compute[74681]: INFO os_vif [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:30:37,bridge_name='br-int',has_traffic_filtering=True,id=25d2f00b-53b1-4a58-a90b-5cb6eb93adba,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d2f00b-53')
Aug 16 06:31:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qcsXNheD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:31:16 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffee439-ce60-4886-a7b4-2562b03d0d2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7cf479-0c32-48d5-a426-9ff40b5705d7]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:31:16 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:31:16 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:31:16 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:31:16 user nova-compute[74681]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)
Aug 16 06:31:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:31:16 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:31:16 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:31:16 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:31:16 user nova-compute[74681]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 (non-flash)
Aug 16 06:31:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94842e36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46'): ({'sdg'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Removing single pathed devices sdg {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7014f7d3-7866-4d56-a2c1-395cd473681f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e452db1e-0264-4d8d-a637-62818804244e]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flushing IO for device /dev/sdg {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd03a411-58f7-4380-85dd-9fd6cdeffd88]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[040cecd4-8be7-4530-a872-1d24d07b25b5]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] SCSI volumes sdg have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe9f8f04d-ea0c51d3dda83ea3', '/dev/disk/by-id/scsi-26561306335316433', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e9f8f04d') {{(pid=121298) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 06:31:16 user nova-compute[74681]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe9f8f04d-ea0c51d3dda83ea3
Aug 16 06:31:16 user nova-compute[74681]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26561306335316433
Aug 16 06:31:16 user nova-compute[74681]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e9f8f04d
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482f574-dbba-432b-a689-a13ea4e3c2e6]: (4, None) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[380d167c-c32c-4923-8c92-edc60c6cca9a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd65171-515b-4523-9e5a-1c5c596676ec]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46, portal: 172.16.0.220,3260]
Aug 16 06:31:16 user nova-compute[74681]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46, portal: 172.16.0.220,3260] successful.
Aug 16 06:31:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b06b3699-ef79-49e5-8fc1-6738b4faaf46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3e0449-b33f-4697-8792-36c31bea7e11]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== disconnect_volume: return (309ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:31:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Deleting instance files /opt/stack/data/nova/instances/e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c_del
Aug 16 06:31:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Deletion of /opt/stack/data/nova/instances/e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c_del complete
Aug 16 06:31:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:16 user nova-compute[74681]: INFO nova.compute.manager [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 16 06:31:16 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:31:16 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:31:17 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:31:17 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Took 0.88 seconds to deallocate network for instance.
Aug 16 06:31:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-c6962449-b2c4-430a-9798-ca1437b0f47a req-03ceca82-64aa-49e2-9fdf-cab04504deb2 service nova] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Received event network-vif-deleted-25d2f00b-53b1-4a58-a90b-5cb6eb93adba {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:18 user nova-compute[74681]: INFO nova.compute.manager [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Terminating instance
Aug 16 06:31:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: INFO nova.compute.manager [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 06:31:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Deleting volume: b06b3699-ef79-49e5-8fc1-6738b4faaf46 {{(pid=74681) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Deleted allocations for instance e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Instance destroyed successfully.
Aug 16 06:31:18 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'resources' on Instance uuid 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1769746501',display_name='tempest-ServerRescueNegativeTestJSON-server-1769746501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1769746501',id=36,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmSo2KxM/KHqSgb3nfjTsKj9pM2kypAKT8/4qdwkDsRFDQqm4dy2PdbZHyYKvvnx8kbEFjx7CA5pnD/JVs17SbMvzdgs2hIRpWHeOUKGWZ+FywpX+QxYxzbi/t41klHZQ==',key_name='tempest-keypair-1975514318',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-la5jnhhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='830eea7441aa4c928dcb598a555e01cd',uuid=7998966b-a074-4d79-bf3f-9c5b9fbc60a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "97185598-923f-4338-a826-e8f18738d20e", "address": "fa:16:3e:de:45:74", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97185598-92", "ovs_interfaceid": "97185598-923f-4338-a826-e8f18738d20e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:45:74,bridge_name='br-int',has_traffic_filtering=True,id=97185598-923f-4338-a826-e8f18738d20e,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97185598-92') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG os_vif [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:45:74,bridge_name='br-int',has_traffic_filtering=True,id=97185598-923f-4338-a826-e8f18738d20e,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97185598-92') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97185598-92, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:18 user nova-compute[74681]: INFO os_vif [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:45:74,bridge_name='br-int',has_traffic_filtering=True,id=97185598-923f-4338-a826-e8f18738d20e,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97185598-92')
Aug 16 06:31:18 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Deleting instance files /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9_del
Aug 16 06:31:18 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Deletion of /opt/stack/data/nova/instances/7998966b-a074-4d79-bf3f-9c5b9fbc60a9_del complete
Aug 16 06:31:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-99f54242-575c-446b-a69c-1c1128d64d86 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.535s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:19 user nova-compute[74681]: INFO nova.compute.manager [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 06:31:19 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-unplugged-97185598-923f-4338-a826-e8f18738d20e for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] Acquiring lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] No waiting events found dispatching network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:31:19 user nova-compute[74681]: WARNING nova.compute.manager [req-4f9e4494-2a0f-4c78-9d7d-5667cb6b0f56 req-3cdad49e-6be8-4cad-a42e-b4a90c865327 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received unexpected event network-vif-plugged-97185598-923f-4338-a826-e8f18738d20e for instance with vm_state active and task_state deleting.
Aug 16 06:31:20 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:31:20 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Took 1.31 seconds to deallocate network for instance.
Aug 16 06:31:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:20 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:31:20 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:31:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:20 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Deleted allocations for instance 7998966b-a074-4d79-bf3f-9c5b9fbc60a9
Aug 16 06:31:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1f1cb0ef-757a-4f4a-aabe-adbc9ef1df55 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "7998966b-a074-4d79-bf3f-9c5b9fbc60a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.712s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:21 user nova-compute[74681]: DEBUG nova.compute.manager [req-f852ca2f-cbec-4463-b379-de8bc5cd7436 req-e7f89fed-0438-44f4-bce0-a330d37dd3e8 service nova] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Received event network-vif-deleted-97185598-923f-4338-a826-e8f18738d20e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:23 user nova-compute[74681]: INFO nova.compute.manager [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Detaching volume b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1
Aug 16 06:31:23 user nova-compute[74681]: INFO nova.virt.block_device [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Attempting to driver detach volume b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 from mountpoint /dev/vdb
Aug 16 06:31:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Attempting to detach device vdb from instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:31:23 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:31:23 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:31:23 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:31:23 user nova-compute[74681]:   <serial>b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1</serial>
Aug 16 06:31:23 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 06:31:23 user nova-compute[74681]: </disk>
Aug 16 06:31:23 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:31:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully detached device vdb from instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed from the persistent domain config.
Aug 16 06:31:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:31:23 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:31:23 user nova-compute[74681]:   <source dev="/dev/sdf"/>
Aug 16 06:31:23 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:31:23 user nova-compute[74681]:   <serial>b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1</serial>
Aug 16 06:31:23 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 06:31:23 user nova-compute[74681]: </disk>
Aug 16 06:31:23 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167483.970602, b8e4f0c3-d421-4612-9ffd-eb882fb72eed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:31:23 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully detached device vdb from instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed from the live domain config.
Aug 16 06:31:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdYvswbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:31:23 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:31:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:31:23 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing instance network info cache due to event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] Acquiring lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] Acquired lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ee5685-6119-4713-9163-50ea13d2302a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7206acab-1602-4b68-93d3-9a69f3215069]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:31:24 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:31:24 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:31:24 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:31:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:31:24 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:31:24 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:31:24 user nova-compute[74681]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 (non-flash)
Aug 16 06:31:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94a1ddcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1'): ({'sdf'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Removing single pathed devices sdf {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b670c97e-753a-46ee-b955-7b9b1e9a60ad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a515aa5a-0618-4ce6-ab81-a2d527c1c935]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flushing IO for device /dev/sdf {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f9081-708e-409e-b2ca-28155df238e9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[51405f9e-a061-4ebb-b044-051af7feafd9]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] SCSI volumes sdf have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b60d2-9f61-4135-b555-59d42b9731b9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[94275858-1788-47d7-b028-4bb9f0798edb]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260]
Aug 16 06:31:24 user nova-compute[74681]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1, portal: 172.16.0.220,3260] successful.
Aug 16 06:31:24 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b78bcbfb-37e6-467a-88f2-8aaf48bbe7c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca6d589-73ac-45dc-98c6-dd8448d5756a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] <== disconnect_volume: return (310ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updated VIF entry in instance network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating instance_info_cache with network_info: [{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] Releasing lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing instance network info cache due to event network-changed-b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] Acquiring lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] Acquired lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Refreshing network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updated VIF entry in instance network info cache for port b76985e8-e864-4b67-acd4-638e9c3c7d78. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG nova.network.neutron [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating instance_info_cache with network_info: [{"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:31:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d5b30f9b-2e37-4902-92af-05296e4af733 req-6b174743-6f17-4a9c-ae71-993f79bad496 service nova] Releasing lock "refresh_cache-b8e4f0c3-d421-4612-9ffd-eb882fb72eed" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:31:25 user nova-compute[74681]: DEBUG nova.objects.instance [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'flavor' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:31:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c0f54395-dcf3-4802-ab4b-70a88c9f6b05 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:31 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167476.2027063, e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:31:31 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] VM Stopped (Lifecycle Event)
Aug 16 06:31:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-92304bf0-b357-499f-9ff7-e595ccb278b8 None None] [instance: e7f9c3e2-cb39-4ec7-96bb-bb9fa2b56f3c] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:31:33 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167478.9012487, 7998966b-a074-4d79-bf3f-9c5b9fbc60a9 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:31:33 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] VM Stopped (Lifecycle Event)
Aug 16 06:31:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f6bf0b5a-7bf9-40d1-8c74-70cf842f003a None None] [instance: 7998966b-a074-4d79-bf3f-9c5b9fbc60a9] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:31:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:31:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-89434bf9-214b-4a4c-ba33-4f958c2c3731 req-4854bc87-4e54-4333-a8a5-cb5e09be58d1 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received event network-changed-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-89434bf9-214b-4a4c-ba33-4f958c2c3731 req-4854bc87-4e54-4333-a8a5-cb5e09be58d1 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Refreshing instance network info cache due to event network-changed-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-89434bf9-214b-4a4c-ba33-4f958c2c3731 req-4854bc87-4e54-4333-a8a5-cb5e09be58d1 service nova] Acquiring lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-89434bf9-214b-4a4c-ba33-4f958c2c3731 req-4854bc87-4e54-4333-a8a5-cb5e09be58d1 service nova] Acquired lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-89434bf9-214b-4a4c-ba33-4f958c2c3731 req-4854bc87-4e54-4333-a8a5-cb5e09be58d1 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Refreshing network info cache for port 061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'flavor' on Instance uuid c9200141-adb8-47a2-901b-a113086c89b7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:31:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Ignoring supplied device name: /dev/vdb
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:43 user nova-compute[74681]: INFO nova.compute.manager [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Attaching volume e923d1e0-459d-4820-878a-512ed8ac8ec5 to /dev/vdb
Aug 16 06:31:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-89434bf9-214b-4a4c-ba33-4f958c2c3731 req-4854bc87-4e54-4333-a8a5-cb5e09be58d1 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Updated VIF entry in instance network info cache for port 061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG nova.network.neutron [req-89434bf9-214b-4a4c-ba33-4f958c2c3731 req-4854bc87-4e54-4333-a8a5-cb5e09be58d1 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Updating instance_info_cache with network_info: [{"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-89434bf9-214b-4a4c-ba33-4f958c2c3731 req-4854bc87-4e54-4333-a8a5-cb5e09be58d1 service nova] Releasing lock "refresh_cache-c9200141-adb8-47a2-901b-a113086c89b7" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG os_brick.utils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd72669-9016-44a9-80dc-477a0ffb55e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100cff9-ebca-4f5d-9954-f59aaaf1d66f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ced389d-8058-4e4e-bfb5-3159c13eb9a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[60672583-e84c-4cf5-84d2-cc31450fe30d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:31:43 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:31:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[263e473e-66a6-4ede-8968-452261b56d81]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG os_brick.utils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Updating existing volume attachment record: c07de067-de0e-4590-aa24-75ee2a4ce37f {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:31:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:31:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:47 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUjrDema', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:31:53 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:31:53 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:31:53 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:31:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:31:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7390MB free_disk=25.01083755493164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be654a0-a614-4fcf-b52d-63191566049d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:31:53 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[33654bc7-5e16-404b-bf46-5edf9c43e24c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5] added
Aug 16 06:31:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4976db4b-b3c8-4d39-87f6-1a539239ff95]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8f176-7afe-461d-b910-7c7d8fb2c4a5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUjrDema {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dUjrDema" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8dfc75-bd2c-46d0-abac-d8ab7d909ccb]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dUjrDema'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec9888c-7c54-4f09-9672-b39a219ba059]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5e675215-481e-4a14-955a-d92d43671e1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 195ea078-71f3-494a-ac7f-8c84992287b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance c9200141-adb8-47a2-901b-a113086c89b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3d65cb82-0f27-4fe5-9723-b620748548c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d503e0b-7eb3-403b-ac22-4b9c66581f39]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:31:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:31:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e05a457-221b-4c56-ade9-715850e36635]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5, portal: 172.16.0.220,3260]
Aug 16 06:31:53 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5, portal: 172.16.0.220,3260] successful.
Aug 16 06:31:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb36d659-97a4-4606-a3c9-303c0acbadc5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1008a-d510-4389-affa-90f5ec2e7f12]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)
Aug 16 06:31:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:31:53 user nova-compute[74681]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)
Aug 16 06:31:53 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a80eef4-c14d-4117-bb78-377c41d23fec]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUjrDema', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26637396461623339', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637396461623339', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'flavor' on Instance uuid c9200141-adb8-47a2-901b-a113086c89b7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:31:54 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:31:54 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:31:54 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:31:54 user nova-compute[74681]:   <serial>e923d1e0-459d-4820-878a-512ed8ac8ec5</serial>
Aug 16 06:31:54 user nova-compute[74681]: </disk>
Aug 16 06:31:54 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] No VIF found with MAC fa:16:3e:7d:42:5a, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:31:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0b99a061-3dea-4985-8499-dc71e73f50d1 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.581s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:31:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:31:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:31:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:31:55 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:31:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updating instance_info_cache with network_info: [{"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:31:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:31:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:31:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:31:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:31:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:31:59 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "195ea078-71f3-494a-ac7f-8c84992287b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "195ea078-71f3-494a-ac7f-8c84992287b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:11 user nova-compute[74681]: INFO nova.compute.manager [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Terminating instance
Aug 16 06:32:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ed3e9f1-b8f2-421a-9b82-48d3b050d1b6 req-b088dcca-8ea9-48e6-9836-3e783fd8045e service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received event network-vif-unplugged-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ed3e9f1-b8f2-421a-9b82-48d3b050d1b6 req-b088dcca-8ea9-48e6-9836-3e783fd8045e service nova] Acquiring lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ed3e9f1-b8f2-421a-9b82-48d3b050d1b6 req-b088dcca-8ea9-48e6-9836-3e783fd8045e service nova] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ed3e9f1-b8f2-421a-9b82-48d3b050d1b6 req-b088dcca-8ea9-48e6-9836-3e783fd8045e service nova] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ed3e9f1-b8f2-421a-9b82-48d3b050d1b6 req-b088dcca-8ea9-48e6-9836-3e783fd8045e service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] No waiting events found dispatching network-vif-unplugged-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:32:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ed3e9f1-b8f2-421a-9b82-48d3b050d1b6 req-b088dcca-8ea9-48e6-9836-3e783fd8045e service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received event network-vif-unplugged-06c9048f-7189-4901-b674-14b4b86f6a1c for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:32:11 user nova-compute[74681]: INFO nova.compute.manager [None req-2a633a77-048c-4054-ba1f-1b803b2264e9 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Get console output
Aug 16 06:32:11 user nova-compute[74681]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 06:32:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Instance destroyed successfully.
Aug 16 06:32:12 user nova-compute[74681]: DEBUG nova.objects.instance [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'resources' on Instance uuid 195ea078-71f3-494a-ac7f-8c84992287b3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1919211299',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1919211299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1919211299',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwYVyy5mJ/CCGvAnpuRMjprY6Xtndfda3Tl/z96gfWTXofNPf3n3KU78ojB2N19/h4p3hhURDU4+snWuGv5CTHDFXTvupBFDkhvY/o5K6hZkD+qfuJXdSuqZwPGGWAKHg==',key_name='tempest-keypair-957897090',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:27:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-qr776drq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efd0444b91944ba5b2d1e3c852456964',uuid=195ea078-71f3-494a-ac7f-8c84992287b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "06c9048f-7189-4901-b674-14b4b86f6a1c", "address": "fa:16:3e:7c:1c:c7", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06c9048f-71", "ovs_interfaceid": "06c9048f-7189-4901-b674-14b4b86f6a1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:1c:c7,bridge_name='br-int',has_traffic_filtering=True,id=06c9048f-7189-4901-b674-14b4b86f6a1c,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c9048f-71') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_vif [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:1c:c7,bridge_name='br-int',has_traffic_filtering=True,id=06c9048f-7189-4901-b674-14b4b86f6a1c,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c9048f-71') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06c9048f-71, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:32:12 user nova-compute[74681]: INFO os_vif [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:1c:c7,bridge_name='br-int',has_traffic_filtering=True,id=06c9048f-7189-4901-b674-14b4b86f6a1c,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06c9048f-71')
Aug 16 06:32:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrUYvtCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:12 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5b503d-9577-4f09-85c8-cb5a7124f5a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5657b-88f1-43eb-bd8a-5057e1ef7782]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:12 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:32:12 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:12 user nova-compute[74681]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)
Aug 16 06:32:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:12 user nova-compute[74681]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b (non-flash)
Aug 16 06:32:12 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:12 user nova-compute[74681]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)
Aug 16 06:32:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948427f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b'): ({'sde'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Removing single pathed devices sde {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3294031d-f763-4dc9-b17a-0819cf9e69e2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69b54d7-e121-44b9-8238-751c596bda65]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flushing IO for device /dev/sde {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f2b812-971d-4df8-912a-91a482dc3450]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc747559-7b1a-4e94-af76-070ffb7ebb50]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5b94b353',) {{(pid=121298) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e140642-eab8-4654-81e6-574cf9f089e4]: (4, None) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa899467-7dac-4cb1-b39a-7a0ac4a8bbd1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[00edba92-24fd-4d1f-997f-d6ce34d26715]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b, portal: 172.16.0.220,3260]
Aug 16 06:32:12 user nova-compute[74681]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b, portal: 172.16.0.220,3260] successful.
Aug 16 06:32:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:586a7d92-5392-4e8a-96c0-6f2b7de4494b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4712605d-568c-4a01-a45e-3a17751f76c4]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== disconnect_volume: return (374ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:32:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Deleting instance files /opt/stack/data/nova/instances/195ea078-71f3-494a-ac7f-8c84992287b3_del
Aug 16 06:32:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Deletion of /opt/stack/data/nova/instances/195ea078-71f3-494a-ac7f-8c84992287b3_del complete
Aug 16 06:32:12 user nova-compute[74681]: INFO nova.compute.manager [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 16 06:32:12 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:32:12 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:32:13 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:32:13 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Took 0.90 seconds to deallocate network for instance.
Aug 16 06:32:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-930449e6-8877-470d-8ec1-3f7f6c3ba297 req-bdc0cd47-4327-418c-99a7-708fcb3a676c service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received event network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-930449e6-8877-470d-8ec1-3f7f6c3ba297 req-bdc0cd47-4327-418c-99a7-708fcb3a676c service nova] Acquiring lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-930449e6-8877-470d-8ec1-3f7f6c3ba297 req-bdc0cd47-4327-418c-99a7-708fcb3a676c service nova] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-930449e6-8877-470d-8ec1-3f7f6c3ba297 req-bdc0cd47-4327-418c-99a7-708fcb3a676c service nova] Lock "195ea078-71f3-494a-ac7f-8c84992287b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-930449e6-8877-470d-8ec1-3f7f6c3ba297 req-bdc0cd47-4327-418c-99a7-708fcb3a676c service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] No waiting events found dispatching network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:32:13 user nova-compute[74681]: WARNING nova.compute.manager [req-930449e6-8877-470d-8ec1-3f7f6c3ba297 req-bdc0cd47-4327-418c-99a7-708fcb3a676c service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received unexpected event network-vif-plugged-06c9048f-7189-4901-b674-14b4b86f6a1c for instance with vm_state active and task_state deleting.
Aug 16 06:32:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-930449e6-8877-470d-8ec1-3f7f6c3ba297 req-bdc0cd47-4327-418c-99a7-708fcb3a676c service nova] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Received event network-vif-deleted-06c9048f-7189-4901-b674-14b4b86f6a1c {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:14 user nova-compute[74681]: INFO nova.compute.manager [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Took 0.81 seconds to detach 1 volumes for instance.
Aug 16 06:32:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Deleting volume: 586a7d92-5392-4e8a-96c0-6f2b7de4494b {{(pid=74681) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 06:32:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:14 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:32:14 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:32:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:14 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Deleted allocations for instance 195ea078-71f3-494a-ac7f-8c84992287b3
Aug 16 06:32:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-73570b14-8452-4595-bd3b-59df39be1483 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "195ea078-71f3-494a-ac7f-8c84992287b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.784s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-35c01e75-1ac1-4659-9aea-c21e2e96d82d req-3afa0f93-229d-4e01-a19a-5b31fb1ed36d service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received event network-changed-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-35c01e75-1ac1-4659-9aea-c21e2e96d82d req-3afa0f93-229d-4e01-a19a-5b31fb1ed36d service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Refreshing instance network info cache due to event network-changed-f06da1d6-d714-4eb6-8ce2-935e2d120d7e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:32:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-35c01e75-1ac1-4659-9aea-c21e2e96d82d req-3afa0f93-229d-4e01-a19a-5b31fb1ed36d service nova] Acquiring lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:32:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-35c01e75-1ac1-4659-9aea-c21e2e96d82d req-3afa0f93-229d-4e01-a19a-5b31fb1ed36d service nova] Acquired lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:32:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-35c01e75-1ac1-4659-9aea-c21e2e96d82d req-3afa0f93-229d-4e01-a19a-5b31fb1ed36d service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Refreshing network info cache for port f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:32:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:18 user nova-compute[74681]: DEBUG nova.network.neutron [req-35c01e75-1ac1-4659-9aea-c21e2e96d82d req-3afa0f93-229d-4e01-a19a-5b31fb1ed36d service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Updated VIF entry in instance network info cache for port f06da1d6-d714-4eb6-8ce2-935e2d120d7e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:32:18 user nova-compute[74681]: DEBUG nova.network.neutron [req-35c01e75-1ac1-4659-9aea-c21e2e96d82d req-3afa0f93-229d-4e01-a19a-5b31fb1ed36d service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Updating instance_info_cache with network_info: [{"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:32:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-35c01e75-1ac1-4659-9aea-c21e2e96d82d req-3afa0f93-229d-4e01-a19a-5b31fb1ed36d service nova] Releasing lock "refresh_cache-3d65cb82-0f27-4fe5-9723-b620748548c1" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:32:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "5e675215-481e-4a14-955a-d92d43671e1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:23 user nova-compute[74681]: INFO nova.compute.manager [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Terminating instance
Aug 16 06:32:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:32:23 user nova-compute[74681]: INFO nova.compute.manager [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Terminating instance
Aug 16 06:32:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-0a2d100e-2f02-4f69-a14d-7f85e7a28680 req-648b80fc-c66c-4e94-896f-0a43a06b1474 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-unplugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0a2d100e-2f02-4f69-a14d-7f85e7a28680 req-648b80fc-c66c-4e94-896f-0a43a06b1474 service nova] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0a2d100e-2f02-4f69-a14d-7f85e7a28680 req-648b80fc-c66c-4e94-896f-0a43a06b1474 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0a2d100e-2f02-4f69-a14d-7f85e7a28680 req-648b80fc-c66c-4e94-896f-0a43a06b1474 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-0a2d100e-2f02-4f69-a14d-7f85e7a28680 req-648b80fc-c66c-4e94-896f-0a43a06b1474 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] No waiting events found dispatching network-vif-unplugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-0a2d100e-2f02-4f69-a14d-7f85e7a28680 req-648b80fc-c66c-4e94-896f-0a43a06b1474 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-unplugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-f1eb594a-4a71-41aa-8931-80822288db5e req-e098d60d-bb31-46ae-834b-375766d74953 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-unplugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f1eb594a-4a71-41aa-8931-80822288db5e req-e098d60d-bb31-46ae-834b-375766d74953 service nova] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f1eb594a-4a71-41aa-8931-80822288db5e req-e098d60d-bb31-46ae-834b-375766d74953 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f1eb594a-4a71-41aa-8931-80822288db5e req-e098d60d-bb31-46ae-834b-375766d74953 service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-f1eb594a-4a71-41aa-8931-80822288db5e req-e098d60d-bb31-46ae-834b-375766d74953 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] No waiting events found dispatching network-vif-unplugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-f1eb594a-4a71-41aa-8931-80822288db5e req-e098d60d-bb31-46ae-834b-375766d74953 service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-unplugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Instance destroyed successfully.
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'resources' on Instance uuid 5e675215-481e-4a14-955a-d92d43671e1a {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1319824773',display_name='tempest-ServerRescueNegativeTestJSON-server-1319824773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1319824773',id=20,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-webr75hy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:17:53Z,user_data=None,user_id='830eea7441aa4c928dcb598a555e01cd',uuid=5e675215-481e-4a14-955a-d92d43671e1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "address": "fa:16:3e:6a:9b:eb", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cebfa23-89", "ovs_interfaceid": "9cebfa23-8934-4e08-9cf9-ac02c7f663b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:9b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9cebfa23-8934-4e08-9cf9-ac02c7f663b7,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cebfa23-89') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG os_vif [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:9b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9cebfa23-8934-4e08-9cf9-ac02c7f663b7,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cebfa23-89') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cebfa23-89, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:32:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Instance destroyed successfully.
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.objects.instance [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'resources' on Instance uuid b8e4f0c3-d421-4612-9ffd-eb882fb72eed {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1861279471',display_name='tempest-TestMinimumBasicScenario-server-1861279471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1861279471',id=39,image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASZyOSjET3GDAIpQC3+ps+9KTk+m6cZvrsP+bZo2Ue/deEESsJytdYN10l+nGGzLIIsfzGIU5bWUT7lqG7VEmzSe/dcAr81t4dxnHCV6jG3DB//xVoOGRHNLu5cH5OdnQ==',key_name='tempest-TestMinimumBasicScenario-1809299411',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:27:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-3im4rpgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b7e981af-6965-4a0f-a22d-19445e4d6bdb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:29:39Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=b8e4f0c3-d421-4612-9ffd-eb882fb72eed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "address": "fa:16:3e:8f:24:33", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76985e8-e8", "ovs_interfaceid": "b76985e8-e864-4b67-acd4-638e9c3c7d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG os_vif [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: INFO os_vif [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:9b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9cebfa23-8934-4e08-9cf9-ac02c7f663b7,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cebfa23-89')
Aug 16 06:32:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Deleting instance files /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a_del
Aug 16 06:32:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Deletion of /opt/stack/data/nova/instances/5e675215-481e-4a14-955a-d92d43671e1a_del complete
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb76985e8-e8, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:32:24 user nova-compute[74681]: INFO os_vif [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:24:33,bridge_name='br-int',has_traffic_filtering=True,id=b76985e8-e864-4b67-acd4-638e9c3c7d78,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76985e8-e8')
Aug 16 06:32:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Deleting instance files /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed_del
Aug 16 06:32:24 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Deletion of /opt/stack/data/nova/instances/b8e4f0c3-d421-4612-9ffd-eb882fb72eed_del complete
Aug 16 06:32:24 user nova-compute[74681]: INFO nova.compute.manager [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 16 06:32:24 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:32:24 user nova-compute[74681]: INFO nova.compute.manager [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 16 06:32:24 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:32:24 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:32:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:25 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:32:25 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:32:25 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Took 0.85 seconds to deallocate network for instance.
Aug 16 06:32:25 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Took 0.86 seconds to deallocate network for instance.
Aug 16 06:32:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.341s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-22d6133e-25bb-4e48-85bf-4fe9c0b65042 req-1fb37a44-5ec9-473c-9762-5b8849450dc4 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-22d6133e-25bb-4e48-85bf-4fe9c0b65042 req-1fb37a44-5ec9-473c-9762-5b8849450dc4 service nova] Acquiring lock "5e675215-481e-4a14-955a-d92d43671e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-22d6133e-25bb-4e48-85bf-4fe9c0b65042 req-1fb37a44-5ec9-473c-9762-5b8849450dc4 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-22d6133e-25bb-4e48-85bf-4fe9c0b65042 req-1fb37a44-5ec9-473c-9762-5b8849450dc4 service nova] Lock "5e675215-481e-4a14-955a-d92d43671e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-22d6133e-25bb-4e48-85bf-4fe9c0b65042 req-1fb37a44-5ec9-473c-9762-5b8849450dc4 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] No waiting events found dispatching network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:32:26 user nova-compute[74681]: WARNING nova.compute.manager [req-22d6133e-25bb-4e48-85bf-4fe9c0b65042 req-1fb37a44-5ec9-473c-9762-5b8849450dc4 service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received unexpected event network-vif-plugged-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 for instance with vm_state deleted and task_state None.
Aug 16 06:32:26 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Deleted allocations for instance 5e675215-481e-4a14-955a-d92d43671e1a
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-06147c33-a14a-476c-b6c0-0354d35cb4f2 req-62135613-3d4e-4555-a43d-e960cc5d76ca service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06147c33-a14a-476c-b6c0-0354d35cb4f2 req-62135613-3d4e-4555-a43d-e960cc5d76ca service nova] Acquiring lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06147c33-a14a-476c-b6c0-0354d35cb4f2 req-62135613-3d4e-4555-a43d-e960cc5d76ca service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06147c33-a14a-476c-b6c0-0354d35cb4f2 req-62135613-3d4e-4555-a43d-e960cc5d76ca service nova] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-06147c33-a14a-476c-b6c0-0354d35cb4f2 req-62135613-3d4e-4555-a43d-e960cc5d76ca service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] No waiting events found dispatching network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:32:26 user nova-compute[74681]: WARNING nova.compute.manager [req-06147c33-a14a-476c-b6c0-0354d35cb4f2 req-62135613-3d4e-4555-a43d-e960cc5d76ca service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received unexpected event network-vif-plugged-b76985e8-e864-4b67-acd4-638e9c3c7d78 for instance with vm_state deleted and task_state None.
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-06147c33-a14a-476c-b6c0-0354d35cb4f2 req-62135613-3d4e-4555-a43d-e960cc5d76ca service nova] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Received event network-vif-deleted-9cebfa23-8934-4e08-9cf9-ac02c7f663b7 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-06147c33-a14a-476c-b6c0-0354d35cb4f2 req-62135613-3d4e-4555-a43d-e960cc5d76ca service nova] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Received event network-vif-deleted-b76985e8-e864-4b67-acd4-638e9c3c7d78 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-0e704136-c984-425f-98e4-f6592234acce tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "5e675215-481e-4a14-955a-d92d43671e1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.679s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:26 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Deleted allocations for instance b8e4f0c3-d421-4612-9ffd-eb882fb72eed
Aug 16 06:32:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-aba79e27-95bd-475a-9dda-17335fd4fa95 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "b8e4f0c3-d421-4612-9ffd-eb882fb72eed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.981s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167532.033823, 195ea078-71f3-494a-ac7f-8c84992287b3 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:32:27 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] VM Stopped (Lifecycle Event)
Aug 16 06:32:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-13e9c724-d784-416a-909f-f162201107d2 None None] [instance: 195ea078-71f3-494a-ac7f-8c84992287b3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:27 user nova-compute[74681]: INFO nova.compute.manager [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Attaching volume a9c2d334-1011-4f21-a1cf-1f170c1a8503 to /dev/vdb
Aug 16 06:32:27 user nova-compute[74681]: DEBUG os_brick.utils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ca50d3-586e-40fd-bd20-1f7be888748e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b227f7-43f7-431e-b15b-734524d90c9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea42b24d-a5b4-4609-bfa9-0f2c8e2a2ecb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e644c4-d71e-436d-9827-3d4be5ea4817]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:32:27 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:32:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fcfefe-8703-45f3-8f74-2063b62bc207]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG os_brick.utils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:27 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Updating existing volume attachment record: 1ce2d03f-cd1b-4667-a4c1-fe317a70a301 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:28 user nova-compute[74681]: INFO nova.compute.manager [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Detaching volume e923d1e0-459d-4820-878a-512ed8ac8ec5
Aug 16 06:32:28 user nova-compute[74681]: INFO nova.virt.block_device [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Attempting to driver detach volume e923d1e0-459d-4820-878a-512ed8ac8ec5 from mountpoint /dev/vdb
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Attempting to detach device vdb from instance c9200141-adb8-47a2-901b-a113086c89b7 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:32:28 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:32:28 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:32:28 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:32:28 user nova-compute[74681]:   <serial>e923d1e0-459d-4820-878a-512ed8ac8ec5</serial>
Aug 16 06:32:28 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:32:28 user nova-compute[74681]: </disk>
Aug 16 06:32:28 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:32:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Successfully detached device vdb from instance c9200141-adb8-47a2-901b-a113086c89b7 from the persistent domain config.
Aug 16 06:32:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9200141-adb8-47a2-901b-a113086c89b7 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:32:28 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:32:28 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:32:28 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:32:28 user nova-compute[74681]:   <serial>e923d1e0-459d-4820-878a-512ed8ac8ec5</serial>
Aug 16 06:32:28 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:32:28 user nova-compute[74681]: </disk>
Aug 16 06:32:28 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167548.6601505, c9200141-adb8-47a2-901b-a113086c89b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9200141-adb8-47a2-901b-a113086c89b7 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:32:28 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Successfully detached device vdb from instance c9200141-adb8-47a2-901b-a113086c89b7 from the live domain config.
Aug 16 06:32:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUjrDema', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:28 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdd5275-59b7-4bfb-8e8a-c5a115e787b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae3bb4a-5996-410a-a2f3-f6c8551d3019]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:28 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:28 user nova-compute[74681]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)
Aug 16 06:32:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:28 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:28 user nova-compute[74681]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 (non-flash)
Aug 16 06:32:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94842e3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e972fd-fffb-4505-8688-f67653407d84]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[651658ab-1b33-4f20-a472-6047dc919611]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c3ae81-de54-4431-97ca-e112a9984440]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead51ecf-1a95-47ae-9b1d-2b8cd9528625]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce2a18-9acd-4f32-a3ff-75ad0b292b22]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01db06c-bc58-4889-a8f5-4ce8eda01abe]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5, portal: 172.16.0.220,3260]
Aug 16 06:32:28 user nova-compute[74681]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5, portal: 172.16.0.220,3260] successful.
Aug 16 06:32:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[871204d8-3b52-4cb2-871f-cb5558a0e29a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] <== disconnect_volume: return (295ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG nova.objects.instance [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'flavor' on Instance uuid c9200141-adb8-47a2-901b-a113086c89b7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-13212777-35aa-4623-a2d3-3a31308ac8d7 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.594s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:29 user nova-compute[74681]: INFO nova.compute.manager [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Terminating instance
Aug 16 06:32:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-82843cec-9ee4-4d84-b10f-5a6f095f0d57 req-5c6b91f2-e291-436d-bcf9-2b930632a4cc service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received event network-vif-unplugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-82843cec-9ee4-4d84-b10f-5a6f095f0d57 req-5c6b91f2-e291-436d-bcf9-2b930632a4cc service nova] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-82843cec-9ee4-4d84-b10f-5a6f095f0d57 req-5c6b91f2-e291-436d-bcf9-2b930632a4cc service nova] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-82843cec-9ee4-4d84-b10f-5a6f095f0d57 req-5c6b91f2-e291-436d-bcf9-2b930632a4cc service nova] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-82843cec-9ee4-4d84-b10f-5a6f095f0d57 req-5c6b91f2-e291-436d-bcf9-2b930632a4cc service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] No waiting events found dispatching network-vif-unplugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-82843cec-9ee4-4d84-b10f-5a6f095f0d57 req-5c6b91f2-e291-436d-bcf9-2b930632a4cc service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received event network-vif-unplugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:32:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Instance destroyed successfully.
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lazy-loading 'resources' on Instance uuid c9200141-adb8-47a2-901b-a113086c89b7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1865982331',display_name='tempest-VolumesSnapshotTestJSON-instance-1865982331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1865982331',id=43,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3q+UiznDz6jDiU1OWfrY/qMPlcIlf21PGJrOIYS0/8HIlGfamBRsTlKkJ7QxMILfIjlb+oIC7Jxx231gUA/za4X9bNRD7rg34xsLqUuKPt/z+8081r3CzoNmKbXIZdPQ==',key_name='tempest-keypair-1870662208',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:29:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01ba755546fe440591b1292c5d74a8f2',ramdisk_id='',reservation_id='r-f0h25z6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-848952719',owner_user_name='tempest-VolumesSnapshotTestJSON-848952719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='586e737fe78c4bf180d51f0470bd8648',uuid=c9200141-adb8-47a2-901b-a113086c89b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converting VIF {"id": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "address": "fa:16:3e:7d:42:5a", "network": {"id": "1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2093260908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01ba755546fe440591b1292c5d74a8f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap061cd7ee-4e", "ovs_interfaceid": "061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:42:5a,bridge_name='br-int',has_traffic_filtering=True,id=061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061cd7ee-4e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_vif [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:42:5a,bridge_name='br-int',has_traffic_filtering=True,id=061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061cd7ee-4e') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap061cd7ee-4e, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:32:30 user nova-compute[74681]: INFO os_vif [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:42:5a,bridge_name='br-int',has_traffic_filtering=True,id=061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a,network=Network(1fc8c77a-c5a4-4c97-bfd9-89b3819cbf51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061cd7ee-4e')
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dUjrDema', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:30 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e923d1e0-459d-4820-878a-512ed8ac8ec5', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec2b93-59d9-42ef-9bdb-4e934034612f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8505df-0562-4296-993f-f3dabf59a78b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:30 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:30 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:30 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:30 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9460683a30>, {}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Disconnecting from: [] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] <== disconnect_volume: return (53ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:32:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Deleting instance files /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7_del
Aug 16 06:32:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Deletion of /opt/stack/data/nova/instances/c9200141-adb8-47a2-901b-a113086c89b7_del complete
Aug 16 06:32:30 user nova-compute[74681]: INFO nova.compute.manager [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 06:32:30 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:32:30 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: c9200141-adb8-47a2-901b-a113086c89b7] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:32:31 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:32:31 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Took 0.86 seconds to deallocate network for instance.
Aug 16 06:32:31 user nova-compute[74681]: WARNING nova.volume.cinder [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Attachment c07de067-de0e-4590-aa24-75ee2a4ce37f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c07de067-de0e-4590-aa24-75ee2a4ce37f. (HTTP 404) (Request-ID: req-b4257147-543e-433c-8bd1-1eb224221d2f)
Aug 16 06:32:31 user nova-compute[74681]: INFO nova.compute.manager [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Took 0.03 seconds to detach 1 volumes for instance.
Aug 16 06:32:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:31 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:32:31 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:32:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:31 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Deleted allocations for instance c9200141-adb8-47a2-901b-a113086c89b7
Aug 16 06:32:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-26c7a2c7-fb15-4387-b656-407fdf01add8 tempest-VolumesSnapshotTestJSON-848952719 tempest-VolumesSnapshotTestJSON-848952719-project-member] Lock "c9200141-adb8-47a2-901b-a113086c89b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.285s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-49bbd3f2-0a24-494a-8085-553d250a5008 req-1ae97471-7f9b-45af-a601-a5eeab03f5c9 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received event network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-49bbd3f2-0a24-494a-8085-553d250a5008 req-1ae97471-7f9b-45af-a601-a5eeab03f5c9 service nova] Acquiring lock "c9200141-adb8-47a2-901b-a113086c89b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-49bbd3f2-0a24-494a-8085-553d250a5008 req-1ae97471-7f9b-45af-a601-a5eeab03f5c9 service nova] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-49bbd3f2-0a24-494a-8085-553d250a5008 req-1ae97471-7f9b-45af-a601-a5eeab03f5c9 service nova] Lock "c9200141-adb8-47a2-901b-a113086c89b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-49bbd3f2-0a24-494a-8085-553d250a5008 req-1ae97471-7f9b-45af-a601-a5eeab03f5c9 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] No waiting events found dispatching network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:32:32 user nova-compute[74681]: WARNING nova.compute.manager [req-49bbd3f2-0a24-494a-8085-553d250a5008 req-1ae97471-7f9b-45af-a601-a5eeab03f5c9 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received unexpected event network-vif-plugged-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a for instance with vm_state deleted and task_state None.
Aug 16 06:32:32 user nova-compute[74681]: DEBUG nova.compute.manager [req-49bbd3f2-0a24-494a-8085-553d250a5008 req-1ae97471-7f9b-45af-a601-a5eeab03f5c9 service nova] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Received event network-vif-deleted-061cd7ee-4e3b-4c0b-9c5f-8ee16d718c7a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYzmCALU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:36 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:36 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:36 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[27164d75-1d46-4e44-9da1-d75d745e264f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:32:36 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2b0251-40cc-40e1-ab6a-0bea50e1c189]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503] added
Aug 16 06:32:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f870304e-ecd2-4fa8-b5c3-bcd1a69699c7]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf918ff2-b55b-462f-b1e7-069c7f466356]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYzmCALU {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYzmCALU" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c094a8f-895b-4ad8-a9ac-2b5f592ff464]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KYzmCALU'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[77506109-854f-47e5-a299-adc45e58bdd1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a28915-598b-4d5d-ae9d-70ea72da2445]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:36 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:36 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[231eeba9-be3b-4550-ab09-dedaca666d96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503, portal: 172.16.0.220,3260]
Aug 16 06:32:36 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503, portal: 172.16.0.220,3260] successful.
Aug 16 06:32:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[73015209-a84d-4785-acf9-7cd4599b1db7]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[495bc03f-7385-47b8-aa97-ec5144e9395b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:36 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:36 user nova-compute[74681]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)
Aug 16 06:32:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:36 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:36 user nova-compute[74681]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)
Aug 16 06:32:36 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b5032d-7f5b-4973-85bb-42b423a0456a]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:32:36 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYzmCALU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:32:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26638646362643034', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638646362643034', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:32:37 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:32:37 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:32:37 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:32:37 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:32:37 user nova-compute[74681]:   <serial>a9c2d334-1011-4f21-a1cf-1f170c1a8503</serial>
Aug 16 06:32:37 user nova-compute[74681]: </disk>
Aug 16 06:32:37 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:32:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:32:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:32:38 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No VIF found with MAC fa:16:3e:04:e8:e6, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:32:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e8f-1325-4245-8348-2af7a18fedda tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.908s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:39 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167544.683895, 5e675215-481e-4a14-955a-d92d43671e1a => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:32:39 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] VM Stopped (Lifecycle Event)
Aug 16 06:32:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1d79ae4e-b486-4bbd-85aa-9f132125793a None None] [instance: 5e675215-481e-4a14-955a-d92d43671e1a] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:32:39 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167544.7091837, b8e4f0c3-d421-4612-9ffd-eb882fb72eed => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:32:39 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] VM Stopped (Lifecycle Event)
Aug 16 06:32:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-adc201e0-1cbc-4425-b97e-5969f896b4be None None] [instance: b8e4f0c3-d421-4612-9ffd-eb882fb72eed] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:32:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:32:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:42 user nova-compute[74681]: DEBUG nova.objects.instance [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:43 user nova-compute[74681]: INFO nova.compute.manager [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Attaching volume 31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c to /dev/vdc
Aug 16 06:32:43 user nova-compute[74681]: DEBUG os_brick.utils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc204e1-6e63-4902-bb37-5b7415d5d384]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f28ab85-40c1-42ee-a636-ba0d697bb31a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc04fac0-f8ff-4b02-9a09-08cb51de439c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec2c18d-f7e1-45d9-9920-dd8f11bf23c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:32:43 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:32:43 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[727923b2-117f-4a10-9744-2c5c422a301f]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG os_brick.utils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:43 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Updating existing volume attachment record: 7f459fef-f12f-4f72-afb2-f37eedbfea6d {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:32:45 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167550.5516672, c9200141-adb8-47a2-901b-a113086c89b7 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:32:45 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: c9200141-adb8-47a2-901b-a113086c89b7] VM Stopped (Lifecycle Event)
Aug 16 06:32:45 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9f081514-1cae-42c0-8f3e-84612ca9c6c8 None None] [instance: c9200141-adb8-47a2-901b-a113086c89b7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:32:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:32:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:32:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7917MB free_disk=25.092395782470703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 3d65cb82-0f27-4fe5-9723-b620748548c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a6ac7136-989e-4e7e-9efe-15d47bff5be3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:32:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.332s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:32:52 user nova-compute[74681]: INFO nova.compute.claims [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Claim successful on node user
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxUVGbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:52 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:52 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:52 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[470fb561-09ad-4e41-b840-ef41db21a8d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:32:52 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9968fc-9513-4662-9f8c-42133493482a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c] added
Aug 16 06:32:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2553476f-01ad-4977-8186-0928a2bc8395]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[36574dc4-b214-466a-810f-0f27cb63d620]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaxUVGbj {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YaxUVGbj" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1706f3a0-98c5-4fd2-a43d-af6c421958bc]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YaxUVGbj'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38791f-758c-440a-ae72-6a41e1032918]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd389c6-4fb8-405b-8993-931ca6653899]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)
Aug 16 06:32:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)
Aug 16 06:32:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc84d7f-c231-436f-9eef-1519818191a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c, portal: 172.16.0.220,3260]
Aug 16 06:32:52 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c, portal: 172.16.0.220,3260] successful.
Aug 16 06:32:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b21ea7-b738-4085-bb69-5434e75ed302]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11ac4e2-b340-40ef-b8c0-00a91fedaf87]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)
Aug 16 06:32:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)
Aug 16 06:32:52 user nova-compute[74681]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)
Aug 16 06:32:52 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[051e52a3-ce00-4f16-bb30-546b6996c5bd]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxUVGbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.network.neutron [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:32:52 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:32:52 user nova-compute[74681]: INFO nova.virt.block_device [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Booting with volume-backed-image 89d7f25c-29d1-41cf-9690-6814b446c3b9 at /dev/vda
Aug 16 06:32:52 user nova-compute[74681]: DEBUG nova.policy [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '361d070042c54dd59f7179619de1d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd289f0a66d5047b7b1be8ca5d969eaea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.network.neutron [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Successfully created port: 63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26163663534323639', 'path': '/dev/sde'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163663534323639', 'path': '/dev/sde'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.objects.instance [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:32:53 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:32:53 user nova-compute[74681]:   <source dev="/dev/sde"/>
Aug 16 06:32:53 user nova-compute[74681]:   <target dev="vdc" bus="virtio"/>
Aug 16 06:32:53 user nova-compute[74681]:   <serial>31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c</serial>
Aug 16 06:32:53 user nova-compute[74681]: </disk>
Aug 16 06:32:53 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] No VIF found with MAC fa:16:3e:04:e8:e6, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.network.neutron [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Successfully updated port: 63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquired lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.network.neutron [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-b9a3a149-9e2d-4147-ac4b-029c829b4f2d req-509fe6a1-1cfd-4810-98a1-43efde3858df service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-changed-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.compute.manager [req-b9a3a149-9e2d-4147-ac4b-029c829b4f2d req-509fe6a1-1cfd-4810-98a1-43efde3858df service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Refreshing instance network info cache due to event network-changed-63d0691b-6e37-40ae-9807-8f63bfa0bf6d. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b9a3a149-9e2d-4147-ac4b-029c829b4f2d req-509fe6a1-1cfd-4810-98a1-43efde3858df service nova] Acquiring lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:32:53 user nova-compute[74681]: DEBUG nova.network.neutron [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:32:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3112b0a9-b944-410d-844f-7723c432c17d tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.023s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:54 user nova-compute[74681]: DEBUG nova.network.neutron [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updating instance_info_cache with network_info: [{"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:32:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Releasing lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:32:54 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance network_info: |[{"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:32:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b9a3a149-9e2d-4147-ac4b-029c829b4f2d req-509fe6a1-1cfd-4810-98a1-43efde3858df service nova] Acquired lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:32:54 user nova-compute[74681]: DEBUG nova.network.neutron [req-b9a3a149-9e2d-4147-ac4b-029c829b4f2d req-509fe6a1-1cfd-4810-98a1-43efde3858df service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Refreshing network info cache for port 63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.network.neutron [req-b9a3a149-9e2d-4147-ac4b-029c829b4f2d req-509fe6a1-1cfd-4810-98a1-43efde3858df service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updated VIF entry in instance network info cache for port 63d0691b-6e37-40ae-9807-8f63bfa0bf6d. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.network.neutron [req-b9a3a149-9e2d-4147-ac4b-029c829b4f2d req-509fe6a1-1cfd-4810-98a1-43efde3858df service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updating instance_info_cache with network_info: [{"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b9a3a149-9e2d-4147-ac4b-029c829b4f2d req-509fe6a1-1cfd-4810-98a1-43efde3858df service nova] Releasing lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:55 user nova-compute[74681]: INFO nova.compute.manager [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Detaching volume a9c2d334-1011-4f21-a1cf-1f170c1a8503
Aug 16 06:32:55 user nova-compute[74681]: INFO nova.virt.block_device [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Attempting to driver detach volume a9c2d334-1011-4f21-a1cf-1f170c1a8503 from mountpoint /dev/vdb
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Attempting to detach device vdb from instance 3d65cb82-0f27-4fe5-9723-b620748548c1 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:32:55 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:32:55 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:32:55 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:32:55 user nova-compute[74681]:   <serial>a9c2d334-1011-4f21-a1cf-1f170c1a8503</serial>
Aug 16 06:32:55 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:32:55 user nova-compute[74681]: </disk>
Aug 16 06:32:55 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:32:55 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully detached device vdb from instance 3d65cb82-0f27-4fe5-9723-b620748548c1 from the persistent domain config.
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d65cb82-0f27-4fe5-9723-b620748548c1 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:32:55 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:32:55 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:32:55 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:32:55 user nova-compute[74681]:   <serial>a9c2d334-1011-4f21-a1cf-1f170c1a8503</serial>
Aug 16 06:32:55 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:32:55 user nova-compute[74681]: </disk>
Aug 16 06:32:55 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167575.7093568, 3d65cb82-0f27-4fe5-9723-b620748548c1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:32:55 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully detached device vdb from instance 3d65cb82-0f27-4fe5-9723-b620748548c1 from the live domain config.
Aug 16 06:32:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYzmCALU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:55 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4445ae05-dbf9-4edd-88ad-3d4bfc985fd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab92b1c-fd0f-4617-af95-ef48d0689ce2]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:55 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:55 user nova-compute[74681]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)
Aug 16 06:32:55 user nova-compute[74681]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)
Aug 16 06:32:55 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:55 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:55 user nova-compute[74681]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 (non-flash)
Aug 16 06:32:55 user nova-compute[74681]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)
Aug 16 06:32:55 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94841ea7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bf8a26-ac87-4f76-93d2-77dcccf28e8e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[107dd224-2b5d-46ad-bb5c-ea927f806927]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d95ebe-16d5-48c2-9454-4830ab7c7f55]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6ab180-c264-4ee8-8602-e0edbc099151]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c133ac5-0b26-4c20-84a9-3c901de5fb5f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f24370c-0c39-400b-9456-04b9e136b2f2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503, portal: 172.16.0.220,3260]
Aug 16 06:32:55 user nova-compute[74681]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503, portal: 172.16.0.220,3260] successful.
Aug 16 06:32:55 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c2d334-1011-4f21-a1cf-1f170c1a8503 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d10d4-f8e3-4b80-93b1-548413e20702]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== disconnect_volume: return (291ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updating instance_info_cache with network_info: [{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8f9a7277-b8a1-4861-aaf0-dbab328ec2c4 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:32:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:32:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:32:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:32:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:32:57 user nova-compute[74681]: INFO nova.compute.manager [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Detaching volume 31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c
Aug 16 06:32:57 user nova-compute[74681]: INFO nova.virt.block_device [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Attempting to driver detach volume 31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c from mountpoint /dev/vdc
Aug 16 06:32:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Attempting to detach device vdc from instance 3d65cb82-0f27-4fe5-9723-b620748548c1 from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:32:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:32:57 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:32:57 user nova-compute[74681]:   <source dev="/dev/sde"/>
Aug 16 06:32:57 user nova-compute[74681]:   <target dev="vdc" bus="virtio"/>
Aug 16 06:32:57 user nova-compute[74681]:   <serial>31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c</serial>
Aug 16 06:32:57 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 06:32:57 user nova-compute[74681]: </disk>
Aug 16 06:32:57 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:32:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully detached device vdc from instance 3d65cb82-0f27-4fe5-9723-b620748548c1 from the persistent domain config.
Aug 16 06:32:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3d65cb82-0f27-4fe5-9723-b620748548c1 from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:32:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:32:57 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:32:57 user nova-compute[74681]:   <source dev="/dev/sde"/>
Aug 16 06:32:57 user nova-compute[74681]:   <target dev="vdc" bus="virtio"/>
Aug 16 06:32:57 user nova-compute[74681]:   <serial>31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c</serial>
Aug 16 06:32:57 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 06:32:57 user nova-compute[74681]: </disk>
Aug 16 06:32:57 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167578.1712902, 3d65cb82-0f27-4fe5-9723-b620748548c1 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:32:58 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully detached device vdc from instance 3d65cb82-0f27-4fe5-9723-b620748548c1 from the live domain config.
Aug 16 06:32:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YaxUVGbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:32:58 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f634f24e-ed70-4994-a831-08594a3ebfc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b3d4e3-699b-416f-8901-ec75b1c8ba7e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:58 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:58 user nova-compute[74681]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)
Aug 16 06:32:58 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:32:58 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:32:58 user nova-compute[74681]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c (non-flash)
Aug 16 06:32:58 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9484662170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c'): ({'sde'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Removing single pathed devices sde {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5df58ce-2547-4ce2-9e2d-9841d9546263]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f8988a-542b-4610-8a3c-73e5f7b8ecd9]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Flushing IO for device /dev/sde {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9c3ce1-493d-438b-b36c-296d3d447249]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a2a59-e414-4672-ad5f-9889efcd01aa]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7f26ba-577b-41c0-8ac3-8399c3951003]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b4345-9985-4a4f-ab3c-19d804bc4ab0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c, portal: 172.16.0.220,3260]
Aug 16 06:32:58 user nova-compute[74681]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c, portal: 172.16.0.220,3260] successful.
Aug 16 06:32:58 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31bdbd76-790e-4cf2-9d7b-c5b1f3a6ff6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd3ad93-d4cc-4a09-8f80-3b6604805ff5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] <== disconnect_volume: return (273ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:32:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:32:59 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'flavor' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:32:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a3c366ce-14bf-485e-b5b7-a466022ab329 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.604s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:00 user nova-compute[74681]: INFO nova.compute.manager [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Terminating instance
Aug 16 06:33:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-1d3acba1-e0e7-4a20-bebc-9094be380c7f req-d2c2782f-8c39-4232-bf19-0dd6c6c6ce9a service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received event network-vif-unplugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1d3acba1-e0e7-4a20-bebc-9094be380c7f req-d2c2782f-8c39-4232-bf19-0dd6c6c6ce9a service nova] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1d3acba1-e0e7-4a20-bebc-9094be380c7f req-d2c2782f-8c39-4232-bf19-0dd6c6c6ce9a service nova] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-1d3acba1-e0e7-4a20-bebc-9094be380c7f req-d2c2782f-8c39-4232-bf19-0dd6c6c6ce9a service nova] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-1d3acba1-e0e7-4a20-bebc-9094be380c7f req-d2c2782f-8c39-4232-bf19-0dd6c6c6ce9a service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] No waiting events found dispatching network-vif-unplugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG nova.compute.manager [req-1d3acba1-e0e7-4a20-bebc-9094be380c7f req-d2c2782f-8c39-4232-bf19-0dd6c6c6ce9a service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received event network-vif-unplugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:00 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Instance destroyed successfully.
Aug 16 06:33:00 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lazy-loading 'resources' on Instance uuid 3d65cb82-0f27-4fe5-9723-b620748548c1 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1518048882',display_name='tempest-AttachVolumeTestJSON-server-1518048882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1518048882',id=44,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyc7eKlzDG5fh1v2rYtxYBQvZc7BwTgoC8aYQzUZec4nIa0nPRlgS+ZQAzZAe5hSGDhn8I4Huw8BBcCXh4V3wKUdiDz/PNcSjDI/D+0usWiEfkzwDRRonlfchvOGmk4mg==',key_name='tempest-keypair-1082346996',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:30:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d50b9e6e8d18446baeb39b48b22aa64d',ramdisk_id='',reservation_id='r-hnw9p0j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-436096878',owner_user_name='tempest-AttachVolumeTestJSON-436096878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca629fd2ab8b4728a772af22f19f48e1',uuid=3d65cb82-0f27-4fe5-9723-b620748548c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converting VIF {"id": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "address": "fa:16:3e:04:e8:e6", "network": {"id": "29aabf0a-90f4-46d9-a560-bb8c10e7c773", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2014603311-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d50b9e6e8d18446baeb39b48b22aa64d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06da1d6-d7", "ovs_interfaceid": "f06da1d6-d714-4eb6-8ce2-935e2d120d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:e8:e6,bridge_name='br-int',has_traffic_filtering=True,id=f06da1d6-d714-4eb6-8ce2-935e2d120d7e,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06da1d6-d7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG os_vif [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:e8:e6,bridge_name='br-int',has_traffic_filtering=True,id=f06da1d6-d714-4eb6-8ce2-935e2d120d7e,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06da1d6-d7') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf06da1d6-d7, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:33:00 user nova-compute[74681]: INFO os_vif [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:e8:e6,bridge_name='br-int',has_traffic_filtering=True,id=f06da1d6-d714-4eb6-8ce2-935e2d120d7e,network=Network(29aabf0a-90f4-46d9-a560-bb8c10e7c773),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06da1d6-d7')
Aug 16 06:33:01 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Deleting instance files /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1_del
Aug 16 06:33:01 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Deletion of /opt/stack/data/nova/instances/3d65cb82-0f27-4fe5-9723-b620748548c1_del complete
Aug 16 06:33:01 user nova-compute[74681]: INFO nova.compute.manager [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 06:33:01 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:33:01 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:33:01 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:33:01 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:33:01 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Took 0.94 seconds to deallocate network for instance.
Aug 16 06:33:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-d697df5c-e6f5-4847-bef5-e0b9201f4940 req-36acdf1d-a2a8-41d6-a2bd-4710d15b426d service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received event network-vif-deleted-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:02 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Deleted allocations for instance 3d65cb82-0f27-4fe5-9723-b620748548c1
Aug 16 06:33:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9f1f898b-e550-4168-9751-1d495a0d8e89 tempest-AttachVolumeTestJSON-436096878 tempest-AttachVolumeTestJSON-436096878-project-member] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.223s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-5f7502d8-97e6-4f1e-8e44-417f94f12a24 req-737d0449-b2e9-4496-a1b3-a6879a14a6c0 service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received event network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5f7502d8-97e6-4f1e-8e44-417f94f12a24 req-737d0449-b2e9-4496-a1b3-a6879a14a6c0 service nova] Acquiring lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5f7502d8-97e6-4f1e-8e44-417f94f12a24 req-737d0449-b2e9-4496-a1b3-a6879a14a6c0 service nova] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5f7502d8-97e6-4f1e-8e44-417f94f12a24 req-737d0449-b2e9-4496-a1b3-a6879a14a6c0 service nova] Lock "3d65cb82-0f27-4fe5-9723-b620748548c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-5f7502d8-97e6-4f1e-8e44-417f94f12a24 req-737d0449-b2e9-4496-a1b3-a6879a14a6c0 service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] No waiting events found dispatching network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:02 user nova-compute[74681]: WARNING nova.compute.manager [req-5f7502d8-97e6-4f1e-8e44-417f94f12a24 req-737d0449-b2e9-4496-a1b3-a6879a14a6c0 service nova] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Received unexpected event network-vif-plugged-f06da1d6-d714-4eb6-8ce2-935e2d120d7e for instance with vm_state deleted and task_state None.
Aug 16 06:33:03 user nova-compute[74681]: DEBUG os_brick.utils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afcf632-5f28-422a-b8d5-ed91a1725e8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[259ae59c-cdad-4592-9c24-418e7e4f9bbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e45c24-d97e-4796-ad4c-8ca8f01eea8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e3b397-4935-4ded-964e-733f626ae5a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:33:03 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:33:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[779b38e1-94e7-4f5d-b590-238410a1b4b0]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG os_brick.utils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:33:03 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updating existing volume attachment record: d8cbf25a-bdc1-483f-9d11-bc60376a85de {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:33:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:33:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Creating image(s)
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Ensure instance console log exists: /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Start _get_guest_xml network_info=[{"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'd8cbf25a-bdc1-483f-9d11-bc60376a85de', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFBwkdLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a6ac7136-989e-4e7e-9efe-15d47bff5be3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd', 'serial': 'a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:33:12 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:33:12 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFBwkdLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:33:12 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:33:12 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:33:12 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc902f34-f963-4861-a540-1b033cfe39cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:33:12 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b072e072-506b-44bb-a088-d8bb8e5665b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd] added
Aug 16 06:33:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a7085-f1bc-4450-aa71-29954cb54ee2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c91148-9cc6-4adb-91b4-aa777a3535c9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFBwkdLE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:12 user nova-compute[74681]: INFO nova.compute.manager [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Terminating instance
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFBwkdLE" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ed1cd2-f932-4fa3-8838-69c033cf7229]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gFBwkdLE'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f1040-b286-480f-9f0a-3b74e60cfa86]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d91c9-5cbb-4332-a7f1-22ee9a7040d3]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:12 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:33:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:12 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:33:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[79091bda-47eb-4584-a00e-6719760ee067]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd, portal: 172.16.0.220,3260]
Aug 16 06:33:12 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd, portal: 172.16.0.220,3260] successful.
Aug 16 06:33:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faad5c6-c58f-4f2a-b055-73552e235eb6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[57502956-32c9-4140-bbf2-8d8f892ebb19]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:12 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:33:12 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:33:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:12 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:33:12 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:33:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[28684efd-9f01-4fb0-b303-0a8826976f30]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFBwkdLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-6b81dfc5-bea4-4f87-b94c-bbc35a18af04 req-9dccea24-6a36-4ffe-bf72-a13f8bee25c5 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-unplugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6b81dfc5-bea4-4f87-b94c-bbc35a18af04 req-9dccea24-6a36-4ffe-bf72-a13f8bee25c5 service nova] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6b81dfc5-bea4-4f87-b94c-bbc35a18af04 req-9dccea24-6a36-4ffe-bf72-a13f8bee25c5 service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6b81dfc5-bea4-4f87-b94c-bbc35a18af04 req-9dccea24-6a36-4ffe-bf72-a13f8bee25c5 service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-6b81dfc5-bea4-4f87-b94c-bbc35a18af04 req-9dccea24-6a36-4ffe-bf72-a13f8bee25c5 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] No waiting events found dispatching network-vif-unplugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-6b81dfc5-bea4-4f87-b94c-bbc35a18af04 req-9dccea24-6a36-4ffe-bf72-a13f8bee25c5 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-unplugged-19c41113-5a63-4592-ac7b-88104f472bab for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:33:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:13 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Instance destroyed successfully.
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.objects.instance [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'resources' on Instance uuid 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1241571183',display_name='tempest-ServerActionsTestOtherA-server-1241571183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1241571183',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-5k4khnid',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=4cacaa1a-0734-4f8d-9e2a-f138bdd06553,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "19c41113-5a63-4592-ac7b-88104f472bab", "address": "fa:16:3e:80:4b:a4", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c41113-5a", "ovs_interfaceid": "19c41113-5a63-4592-ac7b-88104f472bab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_vif [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19c41113-5a, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:33:13 user nova-compute[74681]: INFO os_vif [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=19c41113-5a63-4592-ac7b-88104f472bab,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c41113-5a')
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwHWlah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:33:13 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23664383838343139', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664383838343139', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.445s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f360efe-238b-4b29-8e60-f141af7eed39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-331157194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-331157194',id=45,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-yvpt7nfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:32:53Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=a6ac7136-989e-4e7e-9efe-15d47bff5be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:85:90,bridge_name='br-int',has_traffic_filtering=True,id=63d0691b-6e37-40ae-9807-8f63bfa0bf6d,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d0691b-6e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.objects.instance [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'pci_devices' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.093s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[866338ab-df8b-4971-a519-b981d85eb3d0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:13 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:33:13 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:33:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:13 user nova-compute[74681]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a (non-flash)
Aug 16 06:33:13 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:33:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f946068a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:33:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:33:13 user nova-compute[74681]:   <uuid>a6ac7136-989e-4e7e-9efe-15d47bff5be3</uuid>
Aug 16 06:33:13 user nova-compute[74681]:   <name>instance-0000002d</name>
Aug 16 06:33:13 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:33:13 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:33:13 user nova-compute[74681]:   <metadata>
Aug 16 06:33:13 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:33:13 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:33:13 user nova-compute[74681]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-331157194</nova:name>
Aug 16 06:33:13 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:33:12</nova:creationTime>
Aug 16 06:33:13 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:33:13 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:33:13 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:33:13 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:33:13 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:33:13 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:33:13 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:33:13 user nova-compute[74681]:       <nova:owner>
Aug 16 06:33:13 user nova-compute[74681]:         <nova:user uuid="361d070042c54dd59f7179619de1d1e9">tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member</nova:user>
Aug 16 06:33:13 user nova-compute[74681]:         <nova:project uuid="d289f0a66d5047b7b1be8ca5d969eaea">tempest-ServerBootFromVolumeStableRescueTest-2074839932</nova:project>
Aug 16 06:33:13 user nova-compute[74681]:       </nova:owner>
Aug 16 06:33:13 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:33:13 user nova-compute[74681]:       <nova:ports>
Aug 16 06:33:13 user nova-compute[74681]:         <nova:port uuid="63d0691b-6e37-40ae-9807-8f63bfa0bf6d">
Aug 16 06:33:13 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 06:33:13 user nova-compute[74681]:         </nova:port>
Aug 16 06:33:13 user nova-compute[74681]:       </nova:ports>
Aug 16 06:33:13 user nova-compute[74681]:     </nova:instance>
Aug 16 06:33:13 user nova-compute[74681]:   </metadata>
Aug 16 06:33:13 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:33:13 user nova-compute[74681]:     <system>
Aug 16 06:33:13 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:33:13 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:33:13 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:33:13 user nova-compute[74681]:       <entry name="serial">a6ac7136-989e-4e7e-9efe-15d47bff5be3</entry>
Aug 16 06:33:13 user nova-compute[74681]:       <entry name="uuid">a6ac7136-989e-4e7e-9efe-15d47bff5be3</entry>
Aug 16 06:33:13 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:33:13 user nova-compute[74681]:     </system>
Aug 16 06:33:13 user nova-compute[74681]:   </sysinfo>
Aug 16 06:33:13 user nova-compute[74681]:   <os>
Aug 16 06:33:13 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:33:13 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:33:13 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:33:13 user nova-compute[74681]:   </os>
Aug 16 06:33:13 user nova-compute[74681]:   <features>
Aug 16 06:33:13 user nova-compute[74681]:     <acpi/>
Aug 16 06:33:13 user nova-compute[74681]:     <apic/>
Aug 16 06:33:13 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:33:13 user nova-compute[74681]:   </features>
Aug 16 06:33:13 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:33:13 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:33:13 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:33:13 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:33:13 user nova-compute[74681]:   </clock>
Aug 16 06:33:13 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:33:13 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:33:13 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:33:13 user nova-compute[74681]:   </cpu>
Aug 16 06:33:13 user nova-compute[74681]:   <devices>
Aug 16 06:33:13 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:33:13 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:33:13 user nova-compute[74681]:       <source dev="/dev/sdb"/>
Aug 16 06:33:13 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:33:13 user nova-compute[74681]:       <serial>a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd</serial>
Aug 16 06:33:13 user nova-compute[74681]:     </disk>
Aug 16 06:33:13 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:33:13 user nova-compute[74681]:       <mac address="fa:16:3e:27:85:90"/>
Aug 16 06:33:13 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:33:13 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:33:13 user nova-compute[74681]:       <target dev="tap63d0691b-6e"/>
Aug 16 06:33:13 user nova-compute[74681]:     </interface>
Aug 16 06:33:13 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:33:13 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/console.log" append="off"/>
Aug 16 06:33:13 user nova-compute[74681]:     </serial>
Aug 16 06:33:13 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:33:13 user nova-compute[74681]:     <video>
Aug 16 06:33:13 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:33:13 user nova-compute[74681]:     </video>
Aug 16 06:33:13 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:33:13 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:33:13 user nova-compute[74681]:     </rng>
Aug 16 06:33:13 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:33:13 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:33:13 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:33:13 user nova-compute[74681]:     </memballoon>
Aug 16 06:33:13 user nova-compute[74681]:   </devices>
Aug 16 06:33:13 user nova-compute[74681]: </domain>
Aug 16 06:33:13 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-331157194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-331157194',id=45,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-yvpt7nfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:32:53Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=a6ac7136-989e-4e7e-9efe-15d47bff5be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:85:90,bridge_name='br-int',has_traffic_filtering=True,id=63d0691b-6e37-40ae-9807-8f63bfa0bf6d,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d0691b-6e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_vif [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:85:90,bridge_name='br-int',has_traffic_filtering=True,id=63d0691b-6e37-40ae-9807-8f63bfa0bf6d,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d0691b-6e') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63d0691b-6e, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63d0691b-6e, col_values=(('external_ids', {'iface-id': '63d0691b-6e37-40ae-9807-8f63bfa0bf6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:85:90', 'vm-uuid': 'a6ac7136-989e-4e7e-9efe-15d47bff5be3'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[687612a2-6bbb-40b7-8258-88e17c8e0041]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:14 user nova-compute[74681]: INFO os_vif [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:85:90,bridge_name='br-int',has_traffic_filtering=True,id=63d0691b-6e37-40ae-9807-8f63bfa0bf6d,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d0691b-6e')
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fcc47a-2926-4f4d-824e-6147462f8c9b]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e40406-f509-4430-809e-f7d1fd7e5f95]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No VIF found with MAC fa:16:3e:27:85:90, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7705037-11a8-4eb7-b4da-ed49e18c8efe]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54478b6-c5ea-4bba-85b1-4c844253e6c3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31f7464-6722-4497-a845-d93a1ce6e50d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260]
Aug 16 06:33:14 user nova-compute[74681]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a, portal: 172.16.0.220,3260] successful.
Aug 16 06:33:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:665615ea-05d5-4978-b77e-5d3712fb916a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0282afb-636e-478b-b232-8b1a1b0ac087]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] <== disconnect_volume: return (840ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:33:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Deleting instance files /opt/stack/data/nova/instances/4cacaa1a-0734-4f8d-9e2a-f138bdd06553_del
Aug 16 06:33:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Deletion of /opt/stack/data/nova/instances/4cacaa1a-0734-4f8d-9e2a-f138bdd06553_del complete
Aug 16 06:33:14 user nova-compute[74681]: INFO nova.compute.manager [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Took 1.71 seconds to destroy the instance on the hypervisor.
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:14 user nova-compute[74681]: INFO nova.compute.manager [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Terminating instance
Aug 16 06:33:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] Acquiring lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] No waiting events found dispatching network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:15 user nova-compute[74681]: WARNING nova.compute.manager [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received unexpected event network-vif-plugged-19c41113-5a63-4592-ac7b-88104f472bab for instance with vm_state active and task_state deleting.
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-44869c4e-e685-43de-91b0-8dabbc0a3474 req-ee05461f-8be3-4c69-aa50-03ee81b1a147 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-unplugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:33:15 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Took 1.10 seconds to deallocate network for instance.
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-61e98d53-0f37-420a-9b7f-07eeeeddd1a5 req-90f67cc3-3f10-43c6-89ae-c59f3b3d4c75 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Received event network-vif-deleted-19c41113-5a63-4592-ac7b-88104f472bab {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:15 user nova-compute[74681]: INFO nova.compute.manager [req-61e98d53-0f37-420a-9b7f-07eeeeddd1a5 req-90f67cc3-3f10-43c6-89ae-c59f3b3d4c75 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Neutron deleted interface 19c41113-5a63-4592-ac7b-88104f472bab; detaching it from the instance and deleting it from the info cache
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.network.neutron [req-61e98d53-0f37-420a-9b7f-07eeeeddd1a5 req-90f67cc3-3f10-43c6-89ae-c59f3b3d4c75 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-61e98d53-0f37-420a-9b7f-07eeeeddd1a5 req-90f67cc3-3f10-43c6-89ae-c59f3b3d4c75 service nova] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Detach interface failed, port_id=19c41113-5a63-4592-ac7b-88104f472bab, reason: Instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Instance destroyed successfully.
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lazy-loading 'resources' on Instance uuid 6485c0f0-71dd-48f3-b2fe-449e1770cda7 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:15:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-933932228',display_name='tempest-ServerRescueNegativeTestJSON-server-933932228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-933932228',id=19,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce6d58d07b1145b493d5a07a40c1eb0c',ramdisk_id='',reservation_id='r-kv2gn6id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-472247401',owner_user_name='tempest-ServerRescueNegativeTestJSON-472247401-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:22:40Z,user_data=None,user_id='830eea7441aa4c928dcb598a555e01cd',uuid=6485c0f0-71dd-48f3-b2fe-449e1770cda7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converting VIF {"id": "470f841a-cded-42c7-968a-0fa5ef24ea55", "address": "fa:16:3e:ec:46:54", "network": {"id": "ddae03f6-36d5-4562-9163-4887622b3f4e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1738103558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce6d58d07b1145b493d5a07a40c1eb0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap470f841a-cd", "ovs_interfaceid": "470f841a-cded-42c7-968a-0fa5ef24ea55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:46:54,bridge_name='br-int',has_traffic_filtering=True,id=470f841a-cded-42c7-968a-0fa5ef24ea55,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470f841a-cd') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG os_vif [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:46:54,bridge_name='br-int',has_traffic_filtering=True,id=470f841a-cded-42c7-968a-0fa5ef24ea55,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470f841a-cd') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap470f841a-cd, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:33:15 user nova-compute[74681]: INFO os_vif [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:46:54,bridge_name='br-int',has_traffic_filtering=True,id=470f841a-cded-42c7-968a-0fa5ef24ea55,network=Network(ddae03f6-36d5-4562-9163-4887622b3f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap470f841a-cd')
Aug 16 06:33:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Deleting instance files /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7_del
Aug 16 06:33:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Deletion of /opt/stack/data/nova/instances/6485c0f0-71dd-48f3-b2fe-449e1770cda7_del complete
Aug 16 06:33:15 user nova-compute[74681]: INFO nova.compute.manager [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-c551dda5-d263-4131-8e32-0ef22b62089d req-133354ce-a48f-4da6-ac8d-27f11cf8172e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c551dda5-d263-4131-8e32-0ef22b62089d req-133354ce-a48f-4da6-ac8d-27f11cf8172e service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c551dda5-d263-4131-8e32-0ef22b62089d req-133354ce-a48f-4da6-ac8d-27f11cf8172e service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c551dda5-d263-4131-8e32-0ef22b62089d req-133354ce-a48f-4da6-ac8d-27f11cf8172e service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-c551dda5-d263-4131-8e32-0ef22b62089d req-133354ce-a48f-4da6-ac8d-27f11cf8172e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:15 user nova-compute[74681]: WARNING nova.compute.manager [req-c551dda5-d263-4131-8e32-0ef22b62089d req-133354ce-a48f-4da6-ac8d-27f11cf8172e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state building and task_state spawning.
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:15 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167580.9674351, 3d65cb82-0f27-4fe5-9723-b620748548c1 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:15 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] VM Stopped (Lifecycle Event)
Aug 16 06:33:16 user nova-compute[74681]: INFO nova.compute.manager [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Took 1.02 seconds to detach 1 volumes for instance.
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Deleting volume: 665615ea-05d5-4978-b77e-5d3712fb916a {{(pid=74681) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b29bbf04-4860-4e8f-b5c4-bc1a3f4d56a5 None None] [instance: 3d65cb82-0f27-4fe5-9723-b620748548c1] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:33:16 user nova-compute[74681]: INFO nova.compute.claims [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Claim successful on node user
Aug 16 06:33:16 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Took 0.71 seconds to deallocate network for instance.
Aug 16 06:33:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.377s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:33:16 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:33:17 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:33:17 user nova-compute[74681]: INFO nova.virt.block_device [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Booting with volume 4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 at /dev/vda
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-8614385e-de7f-4413-ad58-d819f4775ae7 req-ba67c45e-f088-49c6-ba28-f597681a9e48 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8614385e-de7f-4413-ad58-d819f4775ae7 req-ba67c45e-f088-49c6-ba28-f597681a9e48 service nova] Acquiring lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8614385e-de7f-4413-ad58-d819f4775ae7 req-ba67c45e-f088-49c6-ba28-f597681a9e48 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8614385e-de7f-4413-ad58-d819f4775ae7 req-ba67c45e-f088-49c6-ba28-f597681a9e48 service nova] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-8614385e-de7f-4413-ad58-d819f4775ae7 req-ba67c45e-f088-49c6-ba28-f597681a9e48 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] No waiting events found dispatching network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:17 user nova-compute[74681]: WARNING nova.compute.manager [req-8614385e-de7f-4413-ad58-d819f4775ae7 req-ba67c45e-f088-49c6-ba28-f597681a9e48 service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received unexpected event network-vif-plugged-470f841a-cded-42c7-968a-0fa5ef24ea55 for instance with vm_state deleted and task_state None.
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.policy [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd0444b91944ba5b2d1e3c852456964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbdfedd72a4b38aaa5acd93ac18163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG os_brick.utils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb9078-2db6-4533-844a-d0549ee9dd3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69db159-379c-4d7f-9dec-243b94c9ee42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c072a4-be0e-48e2-9aab-bc24b87f3254]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2242fa9-e86d-454d-b4e1-d81aa9130495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:33:17 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4875c50-f389-4b53-8e07-e2eb3accd31e]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.709s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG os_brick.utils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Updating existing volume attachment record: 95c7694f-1070-4ce5-bd8f-37ce34352e65 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:33:17 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Deleted allocations for instance 6485c0f0-71dd-48f3-b2fe-449e1770cda7
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2631c9c4-c4b1-4049-ba11-4a35056c7fd2 tempest-ServerRescueNegativeTestJSON-472247401 tempest-ServerRescueNegativeTestJSON-472247401-project-member] Lock "6485c0f0-71dd-48f3-b2fe-449e1770cda7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.076s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-0089ab4b-b986-45f0-919d-b66b4385a900 req-e6677419-8154-4ca7-b095-3794bd89fd3a service nova] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Received event network-vif-deleted-470f841a-cded-42c7-968a-0fa5ef24ea55 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:17 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Deleted allocations for instance 4cacaa1a-0734-4f8d-9e2a-f138bdd06553
Aug 16 06:33:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-ea127bb7-5a8b-4095-a0e6-0359ae60c477 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "4cacaa1a-0734-4f8d-9e2a-f138bdd06553" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.194s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167597.9083333, a6ac7136-989e-4e7e-9efe-15d47bff5be3 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:17 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] VM Resumed (Lifecycle Event)
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:33:17 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance spawned successfully.
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Successfully created port: 1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:33:17 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:33:18 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167597.9103644, a6ac7136-989e-4e7e-9efe-15d47bff5be3 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:18 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] VM Started (Lifecycle Event)
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-a4f49342-9319-4260-b19d-af522e61a9b2 req-986765f7-2704-4693-a841-a053df238046 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a4f49342-9319-4260-b19d-af522e61a9b2 req-986765f7-2704-4693-a841-a053df238046 service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a4f49342-9319-4260-b19d-af522e61a9b2 req-986765f7-2704-4693-a841-a053df238046 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a4f49342-9319-4260-b19d-af522e61a9b2 req-986765f7-2704-4693-a841-a053df238046 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-a4f49342-9319-4260-b19d-af522e61a9b2 req-986765f7-2704-4693-a841-a053df238046 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:18 user nova-compute[74681]: WARNING nova.compute.manager [req-a4f49342-9319-4260-b19d-af522e61a9b2 req-986765f7-2704-4693-a841-a053df238046 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state building and task_state spawning.
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:33:18 user nova-compute[74681]: INFO nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:18 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:33:18 user nova-compute[74681]: INFO nova.compute.manager [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Took 26.41 seconds to build instance.
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-3cd0d4c1-07d7-4698-92bf-468d70d04ff1 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.509s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Successfully updated port: 1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:33:18 user nova-compute[74681]: INFO nova.compute.claims [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Claim successful on node user
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquired lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:33:18 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.network.neutron [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Updating instance_info_cache with network_info: [{"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Releasing lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Instance network_info: |[{"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.network.neutron [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:33:19 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.policy [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffd09ff1adb847afae4d0dc786a661e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51e79d8a3ec4a3b877a82b3863c5a10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:33:19 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Creating image(s)
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "/opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "/opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "/opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "6a570034467baa0d217f7af8876238e622bc04cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "6a570034467baa0d217f7af8876238e622bc04cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-5fc254a5-9553-4c1d-a6ab-825f5bc6ea80 req-2fb3c6f5-ca6d-41b8-95f7-cd10bdfc06d1 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received event network-changed-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-5fc254a5-9553-4c1d-a6ab-825f5bc6ea80 req-2fb3c6f5-ca6d-41b8-95f7-cd10bdfc06d1 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Refreshing instance network info cache due to event network-changed-1e041cfa-15f0-4569-8a0f-7e129055d5b4. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5fc254a5-9553-4c1d-a6ab-825f5bc6ea80 req-2fb3c6f5-ca6d-41b8-95f7-cd10bdfc06d1 service nova] Acquiring lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5fc254a5-9553-4c1d-a6ab-825f5bc6ea80 req-2fb3c6f5-ca6d-41b8-95f7-cd10bdfc06d1 service nova] Acquired lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:33:19 user nova-compute[74681]: DEBUG nova.network.neutron [req-5fc254a5-9553-4c1d-a6ab-825f5bc6ea80 req-2fb3c6f5-ca6d-41b8-95f7-cd10bdfc06d1 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Refreshing network info cache for port 1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf.part --force-share --output=json" returned: 0 in 0.219s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG nova.virt.images [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] bfa6bfcc-0172-4a00-9006-68bb2633ce65 was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf.part /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf.part /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf.converted" returned: 0 in 0.459s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "6a570034467baa0d217f7af8876238e622bc04cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.398s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG nova.network.neutron [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Successfully created port: 8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf --force-share --output=json" returned: 0 in 0.236s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "6a570034467baa0d217f7af8876238e622bc04cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "6a570034467baa0d217f7af8876238e622bc04cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG nova.network.neutron [req-5fc254a5-9553-4c1d-a6ab-825f5bc6ea80 req-2fb3c6f5-ca6d-41b8-95f7-cd10bdfc06d1 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Updated VIF entry in instance network info cache for port 1e041cfa-15f0-4569-8a0f-7e129055d5b4. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG nova.network.neutron [req-5fc254a5-9553-4c1d-a6ab-825f5bc6ea80 req-2fb3c6f5-ca6d-41b8-95f7-cd10bdfc06d1 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Updating instance_info_cache with network_info: [{"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5fc254a5-9553-4c1d-a6ab-825f5bc6ea80 req-2fb3c6f5-ca6d-41b8-95f7-cd10bdfc06d1 service nova] Releasing lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf --force-share --output=json" returned: 0 in 0.220s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf,backing_fmt=raw /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf,backing_fmt=raw /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk 1073741824" returned: 0 in 0.057s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "6a570034467baa0d217f7af8876238e622bc04cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf --force-share --output=json" returned: 0 in 0.219s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Cannot resize image /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG nova.objects.instance [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'migration_context' on Instance uuid 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Ensure instance console log exists: /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Successfully updated port: 8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquired lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-537c466b-8de8-481e-8408-cb0c45d150fc req-62200065-50b8-4c9b-b25d-a9ee8e3bcad0 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.compute.manager [req-537c466b-8de8-481e-8408-cb0c45d150fc req-62200065-50b8-4c9b-b25d-a9ee8e3bcad0 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing instance network info cache due to event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-537c466b-8de8-481e-8408-cb0c45d150fc req-62200065-50b8-4c9b-b25d-a9ee8e3bcad0 service nova] Acquiring lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.neutron [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating instance_info_cache with network_info: [{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Releasing lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Instance network_info: |[{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-537c466b-8de8-481e-8408-cb0c45d150fc req-62200065-50b8-4c9b-b25d-a9ee8e3bcad0 service nova] Acquired lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.neutron [req-537c466b-8de8-481e-8408-cb0c45d150fc req-62200065-50b8-4c9b-b25d-a9ee8e3bcad0 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Start _get_guest_xml network_info=[{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:33:15Z,direct_url=<?>,disk_format='qcow2',id=bfa6bfcc-0172-4a00-9006-68bb2633ce65,min_disk=0,min_ram=0,name='tempest-scenario-img--1449077103',owner='d51e79d8a3ec4a3b877a82b3863c5a10',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:33:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': 'bfa6bfcc-0172-4a00-9006-68bb2633ce65'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:33:22 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:33:22 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:33:15Z,direct_url=<?>,disk_format='qcow2',id=bfa6bfcc-0172-4a00-9006-68bb2633ce65,min_disk=0,min_ram=0,name='tempest-scenario-img--1449077103',owner='d51e79d8a3ec4a3b877a82b3863c5a10',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:33:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-291200869',display_name='tempest-TestMinimumBasicScenario-server-291200869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-291200869',id=47,image_ref='bfa6bfcc-0172-4a00-9006-68bb2633ce65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZGrSnhEeEQogILyhnl2N4m9kA04pT4sYbGeS9B+8tKYm/HaZ1bt+aZfdeBHBVckBm+L5KfBbk9A+Jjv15bxCpagjT2NryXW9KYtyViL4UVC/uSBFIrbFPNy+n8l1p+Dg==',key_name='tempest-TestMinimumBasicScenario-1229642197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-467oe12w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bfa6bfcc-0172-4a00-9006-68bb2633ce65',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:33:19Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=8111c0c7-5bf6-493e-8e8b-b9bb091e82fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:14,bridge_name='br-int',has_traffic_filtering=True,id=8e510d87-d382-4e3b-b684-aca0fed10cec,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e510d87-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.objects.instance [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'pci_devices' on Instance uuid 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:33:22 user nova-compute[74681]:   <uuid>8111c0c7-5bf6-493e-8e8b-b9bb091e82fc</uuid>
Aug 16 06:33:22 user nova-compute[74681]:   <name>instance-0000002f</name>
Aug 16 06:33:22 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:33:22 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:33:22 user nova-compute[74681]:   <metadata>
Aug 16 06:33:22 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:33:22 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:33:22 user nova-compute[74681]:       <nova:name>tempest-TestMinimumBasicScenario-server-291200869</nova:name>
Aug 16 06:33:22 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:33:22</nova:creationTime>
Aug 16 06:33:22 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:33:22 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:33:22 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:33:22 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:33:22 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:33:22 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:33:22 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:33:22 user nova-compute[74681]:       <nova:owner>
Aug 16 06:33:22 user nova-compute[74681]:         <nova:user uuid="ffd09ff1adb847afae4d0dc786a661e7">tempest-TestMinimumBasicScenario-1506407050-project-member</nova:user>
Aug 16 06:33:22 user nova-compute[74681]:         <nova:project uuid="d51e79d8a3ec4a3b877a82b3863c5a10">tempest-TestMinimumBasicScenario-1506407050</nova:project>
Aug 16 06:33:22 user nova-compute[74681]:       </nova:owner>
Aug 16 06:33:22 user nova-compute[74681]:       <nova:root type="image" uuid="bfa6bfcc-0172-4a00-9006-68bb2633ce65"/>
Aug 16 06:33:22 user nova-compute[74681]:       <nova:ports>
Aug 16 06:33:22 user nova-compute[74681]:         <nova:port uuid="8e510d87-d382-4e3b-b684-aca0fed10cec">
Aug 16 06:33:22 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:33:22 user nova-compute[74681]:         </nova:port>
Aug 16 06:33:22 user nova-compute[74681]:       </nova:ports>
Aug 16 06:33:22 user nova-compute[74681]:     </nova:instance>
Aug 16 06:33:22 user nova-compute[74681]:   </metadata>
Aug 16 06:33:22 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:33:22 user nova-compute[74681]:     <system>
Aug 16 06:33:22 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:33:22 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:33:22 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:33:22 user nova-compute[74681]:       <entry name="serial">8111c0c7-5bf6-493e-8e8b-b9bb091e82fc</entry>
Aug 16 06:33:22 user nova-compute[74681]:       <entry name="uuid">8111c0c7-5bf6-493e-8e8b-b9bb091e82fc</entry>
Aug 16 06:33:22 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:33:22 user nova-compute[74681]:     </system>
Aug 16 06:33:22 user nova-compute[74681]:   </sysinfo>
Aug 16 06:33:22 user nova-compute[74681]:   <os>
Aug 16 06:33:22 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:33:22 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:33:22 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:33:22 user nova-compute[74681]:   </os>
Aug 16 06:33:22 user nova-compute[74681]:   <features>
Aug 16 06:33:22 user nova-compute[74681]:     <acpi/>
Aug 16 06:33:22 user nova-compute[74681]:     <apic/>
Aug 16 06:33:22 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:33:22 user nova-compute[74681]:   </features>
Aug 16 06:33:22 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:33:22 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:33:22 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:33:22 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:33:22 user nova-compute[74681]:   </clock>
Aug 16 06:33:22 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:33:22 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:33:22 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:33:22 user nova-compute[74681]:   </cpu>
Aug 16 06:33:22 user nova-compute[74681]:   <devices>
Aug 16 06:33:22 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:33:22 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:33:22 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk"/>
Aug 16 06:33:22 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:33:22 user nova-compute[74681]:     </disk>
Aug 16 06:33:22 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:33:22 user nova-compute[74681]:       <mac address="fa:16:3e:43:9e:14"/>
Aug 16 06:33:22 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:33:22 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:33:22 user nova-compute[74681]:       <target dev="tap8e510d87-d3"/>
Aug 16 06:33:22 user nova-compute[74681]:     </interface>
Aug 16 06:33:22 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:33:22 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/console.log" append="off"/>
Aug 16 06:33:22 user nova-compute[74681]:     </serial>
Aug 16 06:33:22 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:33:22 user nova-compute[74681]:     <video>
Aug 16 06:33:22 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:33:22 user nova-compute[74681]:     </video>
Aug 16 06:33:22 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:33:22 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:33:22 user nova-compute[74681]:     </rng>
Aug 16 06:33:22 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:33:22 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:33:22 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:33:22 user nova-compute[74681]:     </memballoon>
Aug 16 06:33:22 user nova-compute[74681]:   </devices>
Aug 16 06:33:22 user nova-compute[74681]: </domain>
Aug 16 06:33:22 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-291200869',display_name='tempest-TestMinimumBasicScenario-server-291200869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-291200869',id=47,image_ref='bfa6bfcc-0172-4a00-9006-68bb2633ce65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZGrSnhEeEQogILyhnl2N4m9kA04pT4sYbGeS9B+8tKYm/HaZ1bt+aZfdeBHBVckBm+L5KfBbk9A+Jjv15bxCpagjT2NryXW9KYtyViL4UVC/uSBFIrbFPNy+n8l1p+Dg==',key_name='tempest-TestMinimumBasicScenario-1229642197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-467oe12w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bfa6bfcc-0172-4a00-9006-68bb2633ce65',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:33:19Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=8111c0c7-5bf6-493e-8e8b-b9bb091e82fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:14,bridge_name='br-int',has_traffic_filtering=True,id=8e510d87-d382-4e3b-b684-aca0fed10cec,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e510d87-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG os_vif [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:14,bridge_name='br-int',has_traffic_filtering=True,id=8e510d87-d382-4e3b-b684-aca0fed10cec,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e510d87-d3') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e510d87-d3, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e510d87-d3, col_values=(('external_ids', {'iface-id': '8e510d87-d382-4e3b-b684-aca0fed10cec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:9e:14', 'vm-uuid': '8111c0c7-5bf6-493e-8e8b-b9bb091e82fc'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:22 user nova-compute[74681]: INFO os_vif [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:9e:14,bridge_name='br-int',has_traffic_filtering=True,id=8e510d87-d382-4e3b-b684-aca0fed10cec,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e510d87-d3')
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:33:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No VIF found with MAC fa:16:3e:43:9e:14, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:33:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-537c466b-8de8-481e-8408-cb0c45d150fc req-62200065-50b8-4c9b-b25d-a9ee8e3bcad0 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updated VIF entry in instance network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:33:23 user nova-compute[74681]: DEBUG nova.network.neutron [req-537c466b-8de8-481e-8408-cb0c45d150fc req-62200065-50b8-4c9b-b25d-a9ee8e3bcad0 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating instance_info_cache with network_info: [{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:33:23 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-537c466b-8de8-481e-8408-cb0c45d150fc req-62200065-50b8-4c9b-b25d-a9ee8e3bcad0 service nova] Releasing lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-05cc586a-4768-4558-9fd9-e6a6177ede50 req-d125f872-b267-4eec-9a70-33d369f965ca service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-05cc586a-4768-4558-9fd9-e6a6177ede50 req-d125f872-b267-4eec-9a70-33d369f965ca service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-05cc586a-4768-4558-9fd9-e6a6177ede50 req-d125f872-b267-4eec-9a70-33d369f965ca service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-05cc586a-4768-4558-9fd9-e6a6177ede50 req-d125f872-b267-4eec-9a70-33d369f965ca service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-05cc586a-4768-4558-9fd9-e6a6177ede50 req-d125f872-b267-4eec-9a70-33d369f965ca service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:24 user nova-compute[74681]: WARNING nova.compute.manager [req-05cc586a-4768-4558-9fd9-e6a6177ede50 req-d125f872-b267-4eec-9a70-33d369f965ca service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state building and task_state spawning.
Aug 16 06:33:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167606.383705, 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] VM Resumed (Lifecycle Event)
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:33:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Instance spawned successfully.
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167606.3849413, 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] VM Started (Lifecycle Event)
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:33:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-ffe7e58e-b6b2-420f-a61c-e489bcbd5d51 req-80b29925-bb75-4148-ad37-3dba303b64e1 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ffe7e58e-b6b2-420f-a61c-e489bcbd5d51 req-80b29925-bb75-4148-ad37-3dba303b64e1 service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ffe7e58e-b6b2-420f-a61c-e489bcbd5d51 req-80b29925-bb75-4148-ad37-3dba303b64e1 service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ffe7e58e-b6b2-420f-a61c-e489bcbd5d51 req-80b29925-bb75-4148-ad37-3dba303b64e1 service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-ffe7e58e-b6b2-420f-a61c-e489bcbd5d51 req-80b29925-bb75-4148-ad37-3dba303b64e1 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:26 user nova-compute[74681]: WARNING nova.compute.manager [req-ffe7e58e-b6b2-420f-a61c-e489bcbd5d51 req-80b29925-bb75-4148-ad37-3dba303b64e1 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state building and task_state spawning.
Aug 16 06:33:26 user nova-compute[74681]: INFO nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Took 6.99 seconds to spawn the instance on the hypervisor.
Aug 16 06:33:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:26 user nova-compute[74681]: INFO nova.compute.manager [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Took 7.83 seconds to build instance.
Aug 16 06:33:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-177c7a31-a93b-43b6-9340-cc659e5a61c7 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.931s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:33:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Creating image(s)
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Ensure instance console log exists: /opt/stack/data/nova/instances/fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Start _get_guest_xml network_info=[{"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '95c7694f-1070-4ce5-bd8f-37ce34352e65', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovRBMXix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e', 'attached_at': '', 'detached_at': '', 'volume_id': '4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9', 'serial': '4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:33:27 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:33:27 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovRBMXix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:33:27 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:33:27 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:33:27 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0a3932-3f66-4430-9f7a-1941c20eeaa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:33:27 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee56cc29-124f-4241-95ee-9afc084950e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9] added
Aug 16 06:33:27 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c73685-76c6-4269-a7c8-6bc9b59b5c49]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14b6e9c-711e-48b5-bf4e-dcc27a2719da]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovRBMXix {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovRBMXix" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88c34d0-4e0c-4866-ab20-72345637f5b0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ovRBMXix'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f2767f-eb9d-4772-a6f9-8255b1f93dd7]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[585468b9-d301-4536-8f88-f1184e3a53c0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:27 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:33:27 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:27 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:33:27 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:33:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf7107-a49b-437c-9e9f-2a68ed88dd01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260]
Aug 16 06:33:28 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260] successful.
Aug 16 06:33:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3031b186-8d50-4752-a776-be678236ac98]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[725cba6f-4cc2-49d6-aecc-7f9781cdb6ca]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:28 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:33:28 user nova-compute[74681]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:33:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:33:28 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:33:28 user nova-compute[74681]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:33:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9446de1c-3ea5-4ba3-8765-86c9832de0a7]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovRBMXix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:33:28 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167593.3749983, 4cacaa1a-0734-4f8d-9e2a-f138bdd06553 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:28 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] VM Stopped (Lifecycle Event)
Aug 16 06:33:28 user nova-compute[74681]: DEBUG nova.compute.manager [None req-ddfaabf1-51a5-4e46-a2aa-6ba188897b6f None None] [instance: 4cacaa1a-0734-4f8d-9e2a-f138bdd06553] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26637663365323734', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637663365323734', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-963071475',display_name='tempest-TestVolumeBootPattern-server-963071475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-963071475',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-p9ehy0e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:33:17Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=1e041cfa-15f0-4569-8a0f-7e129055d5b4,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e041cfa-15') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'pci_devices' on Instance uuid fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:33:29 user nova-compute[74681]:   <uuid>fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e</uuid>
Aug 16 06:33:29 user nova-compute[74681]:   <name>instance-0000002e</name>
Aug 16 06:33:29 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:33:29 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:33:29 user nova-compute[74681]:   <metadata>
Aug 16 06:33:29 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:33:29 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:33:29 user nova-compute[74681]:       <nova:name>tempest-TestVolumeBootPattern-server-963071475</nova:name>
Aug 16 06:33:29 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:33:27</nova:creationTime>
Aug 16 06:33:29 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:33:29 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:33:29 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:33:29 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:33:29 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:33:29 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:33:29 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:33:29 user nova-compute[74681]:       <nova:owner>
Aug 16 06:33:29 user nova-compute[74681]:         <nova:user uuid="efd0444b91944ba5b2d1e3c852456964">tempest-TestVolumeBootPattern-702107063-project-member</nova:user>
Aug 16 06:33:29 user nova-compute[74681]:         <nova:project uuid="3fbbdfedd72a4b38aaa5acd93ac18163">tempest-TestVolumeBootPattern-702107063</nova:project>
Aug 16 06:33:29 user nova-compute[74681]:       </nova:owner>
Aug 16 06:33:29 user nova-compute[74681]:       <nova:ports>
Aug 16 06:33:29 user nova-compute[74681]:         <nova:port uuid="1e041cfa-15f0-4569-8a0f-7e129055d5b4">
Aug 16 06:33:29 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 06:33:29 user nova-compute[74681]:         </nova:port>
Aug 16 06:33:29 user nova-compute[74681]:       </nova:ports>
Aug 16 06:33:29 user nova-compute[74681]:     </nova:instance>
Aug 16 06:33:29 user nova-compute[74681]:   </metadata>
Aug 16 06:33:29 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:33:29 user nova-compute[74681]:     <system>
Aug 16 06:33:29 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:33:29 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:33:29 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:33:29 user nova-compute[74681]:       <entry name="serial">fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e</entry>
Aug 16 06:33:29 user nova-compute[74681]:       <entry name="uuid">fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e</entry>
Aug 16 06:33:29 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:33:29 user nova-compute[74681]:     </system>
Aug 16 06:33:29 user nova-compute[74681]:   </sysinfo>
Aug 16 06:33:29 user nova-compute[74681]:   <os>
Aug 16 06:33:29 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:33:29 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:33:29 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:33:29 user nova-compute[74681]:   </os>
Aug 16 06:33:29 user nova-compute[74681]:   <features>
Aug 16 06:33:29 user nova-compute[74681]:     <acpi/>
Aug 16 06:33:29 user nova-compute[74681]:     <apic/>
Aug 16 06:33:29 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:33:29 user nova-compute[74681]:   </features>
Aug 16 06:33:29 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:33:29 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:33:29 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:33:29 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:33:29 user nova-compute[74681]:   </clock>
Aug 16 06:33:29 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:33:29 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:33:29 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:33:29 user nova-compute[74681]:   </cpu>
Aug 16 06:33:29 user nova-compute[74681]:   <devices>
Aug 16 06:33:29 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:33:29 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:33:29 user nova-compute[74681]:       <source dev="/dev/sdd"/>
Aug 16 06:33:29 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:33:29 user nova-compute[74681]:       <serial>4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9</serial>
Aug 16 06:33:29 user nova-compute[74681]:     </disk>
Aug 16 06:33:29 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:33:29 user nova-compute[74681]:       <mac address="fa:16:3e:b3:2b:e2"/>
Aug 16 06:33:29 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:33:29 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:33:29 user nova-compute[74681]:       <target dev="tap1e041cfa-15"/>
Aug 16 06:33:29 user nova-compute[74681]:     </interface>
Aug 16 06:33:29 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:33:29 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e/console.log" append="off"/>
Aug 16 06:33:29 user nova-compute[74681]:     </serial>
Aug 16 06:33:29 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:33:29 user nova-compute[74681]:     <video>
Aug 16 06:33:29 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:33:29 user nova-compute[74681]:     </video>
Aug 16 06:33:29 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:33:29 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:33:29 user nova-compute[74681]:     </rng>
Aug 16 06:33:29 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:33:29 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:33:29 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:33:29 user nova-compute[74681]:     </memballoon>
Aug 16 06:33:29 user nova-compute[74681]:   </devices>
Aug 16 06:33:29 user nova-compute[74681]: </domain>
Aug 16 06:33:29 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-963071475',display_name='tempest-TestVolumeBootPattern-server-963071475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-963071475',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-p9ehy0e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:33:17Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=1e041cfa-15f0-4569-8a0f-7e129055d5b4,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e041cfa-15') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG os_vif [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=1e041cfa-15f0-4569-8a0f-7e129055d5b4,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e041cfa-15') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e041cfa-15, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e041cfa-15, col_values=(('external_ids', {'iface-id': '1e041cfa-15f0-4569-8a0f-7e129055d5b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:2b:e2', 'vm-uuid': 'fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:29 user nova-compute[74681]: INFO os_vif [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=1e041cfa-15f0-4569-8a0f-7e129055d5b4,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e041cfa-15')
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:33:29 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No VIF found with MAC fa:16:3e:b3:2b:e2, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167595.6647604, 6485c0f0-71dd-48f3-b2fe-449e1770cda7 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:30 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] VM Stopped (Lifecycle Event)
Aug 16 06:33:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7760f9ef-e7af-4e83-bc75-90970ac70782 None None] [instance: 6485c0f0-71dd-48f3-b2fe-449e1770cda7] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-212b4252-8fcc-499e-abb5-e804102aeb4b req-724ad2f0-be8b-4d73-84e2-952abf85924c service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received event network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-212b4252-8fcc-499e-abb5-e804102aeb4b req-724ad2f0-be8b-4d73-84e2-952abf85924c service nova] Acquiring lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-212b4252-8fcc-499e-abb5-e804102aeb4b req-724ad2f0-be8b-4d73-84e2-952abf85924c service nova] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-212b4252-8fcc-499e-abb5-e804102aeb4b req-724ad2f0-be8b-4d73-84e2-952abf85924c service nova] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:30 user nova-compute[74681]: DEBUG nova.compute.manager [req-212b4252-8fcc-499e-abb5-e804102aeb4b req-724ad2f0-be8b-4d73-84e2-952abf85924c service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] No waiting events found dispatching network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:30 user nova-compute[74681]: WARNING nova.compute.manager [req-212b4252-8fcc-499e-abb5-e804102aeb4b req-724ad2f0-be8b-4d73-84e2-952abf85924c service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received unexpected event network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 for instance with vm_state building and task_state spawning.
Aug 16 06:33:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167612.8463373, fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] VM Resumed (Lifecycle Event)
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:33:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Instance spawned successfully.
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:33:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167612.8475068, fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:33:32 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] VM Started (Lifecycle Event)
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:32 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:33:33 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:33:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-e5efa2d4-393b-4899-b101-7e9f8f19c043 req-15ca7486-d379-4ec9-b7a3-caa7eb124e55 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received event network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:33:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e5efa2d4-393b-4899-b101-7e9f8f19c043 req-15ca7486-d379-4ec9-b7a3-caa7eb124e55 service nova] Acquiring lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e5efa2d4-393b-4899-b101-7e9f8f19c043 req-15ca7486-d379-4ec9-b7a3-caa7eb124e55 service nova] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e5efa2d4-393b-4899-b101-7e9f8f19c043 req-15ca7486-d379-4ec9-b7a3-caa7eb124e55 service nova] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-e5efa2d4-393b-4899-b101-7e9f8f19c043 req-15ca7486-d379-4ec9-b7a3-caa7eb124e55 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] No waiting events found dispatching network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:33:33 user nova-compute[74681]: WARNING nova.compute.manager [req-e5efa2d4-393b-4899-b101-7e9f8f19c043 req-15ca7486-d379-4ec9-b7a3-caa7eb124e55 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received unexpected event network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 for instance with vm_state building and task_state spawning.
Aug 16 06:33:33 user nova-compute[74681]: INFO nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 16 06:33:33 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:33:33 user nova-compute[74681]: INFO nova.compute.manager [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Took 16.65 seconds to build instance.
Aug 16 06:33:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8889245a-b365-4722-ac66-68e1be74358f tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.238s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:33:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:33:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=25.095149993896484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a6ac7136-989e-4e7e-9efe-15d47bff5be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:33:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:33:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:54 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:33:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:33:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Didn't find any instances for network info cache update. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 06:33:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:33:58 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:33:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:01 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:10 user nova-compute[74681]: INFO nova.compute.manager [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Terminating instance
Aug 16 06:34:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:34:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-ce2824f1-4b8f-4db0-96d4-357b98f6a21f req-591dfedc-72b5-41fc-9ca6-ec737a5c1449 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-vif-unplugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce2824f1-4b8f-4db0-96d4-357b98f6a21f req-591dfedc-72b5-41fc-9ca6-ec737a5c1449 service nova] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce2824f1-4b8f-4db0-96d4-357b98f6a21f req-591dfedc-72b5-41fc-9ca6-ec737a5c1449 service nova] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ce2824f1-4b8f-4db0-96d4-357b98f6a21f req-591dfedc-72b5-41fc-9ca6-ec737a5c1449 service nova] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-ce2824f1-4b8f-4db0-96d4-357b98f6a21f req-591dfedc-72b5-41fc-9ca6-ec737a5c1449 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] No waiting events found dispatching network-vif-unplugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-ce2824f1-4b8f-4db0-96d4-357b98f6a21f req-591dfedc-72b5-41fc-9ca6-ec737a5c1449 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-vif-unplugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:34:11 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Instance destroyed successfully.
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.objects.instance [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lazy-loading 'resources' on Instance uuid 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1460264594',display_name='tempest-ServerActionsTestOtherA-server-1460264594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1460264594',id=17,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtfEWdtGKy/sDIeWSU4q+H8+AC2+eGTLYjxcOPUIYqfxeR1MZe8sP6nEBTN2qPrVDWv/sNzw9QcqRVo+cTHyogQKUUFR24fhcP2ZfVEnrAvam9nwiKS88O82ca28iwBtA==',key_name='tempest-keypair-784649962',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:15:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='845526507c1a4a9eadc6c45271cceb94',ramdisk_id='',reservation_id='r-cso4fy4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2037182259',owner_user_name='tempest-ServerActionsTestOtherA-2037182259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='790c60ee58a549ddaabd5f0badcb77fe',uuid=5fc4c990-cc82-410a-b3fc-f931aa20b9b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converting VIF {"id": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "address": "fa:16:3e:d2:aa:7a", "network": {"id": "be73424b-4caa-4090-ad1e-6c89b1940207", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1597326283-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "845526507c1a4a9eadc6c45271cceb94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395eef1a-74", "ovs_interfaceid": "395eef1a-74ab-41c3-b9d0-db18c0cfbb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:aa:7a,bridge_name='br-int',has_traffic_filtering=True,id=395eef1a-74ab-41c3-b9d0-db18c0cfbb82,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395eef1a-74') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG os_vif [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:aa:7a,bridge_name='br-int',has_traffic_filtering=True,id=395eef1a-74ab-41c3-b9d0-db18c0cfbb82,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395eef1a-74') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap395eef1a-74, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:34:11 user nova-compute[74681]: INFO os_vif [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:aa:7a,bridge_name='br-int',has_traffic_filtering=True,id=395eef1a-74ab-41c3-b9d0-db18c0cfbb82,network=Network(be73424b-4caa-4090-ad1e-6c89b1940207),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395eef1a-74')
Aug 16 06:34:11 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Deleting instance files /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3_del
Aug 16 06:34:11 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Deletion of /opt/stack/data/nova/instances/5fc4c990-cc82-410a-b3fc-f931aa20b9b3_del complete
Aug 16 06:34:11 user nova-compute[74681]: INFO nova.compute.manager [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 16 06:34:11 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:34:11 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:34:12 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:34:12 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Took 0.91 seconds to deallocate network for instance.
Aug 16 06:34:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-feb97dab-c95c-403a-bfea-63d3129ba569 req-b428d2ed-7671-4e83-a3ef-67cdd36861c0 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-vif-deleted-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:34:12 user nova-compute[74681]: INFO nova.compute.manager [req-feb97dab-c95c-403a-bfea-63d3129ba569 req-b428d2ed-7671-4e83-a3ef-67cdd36861c0 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Neutron deleted interface 395eef1a-74ab-41c3-b9d0-db18c0cfbb82; detaching it from the instance and deleting it from the info cache
Aug 16 06:34:12 user nova-compute[74681]: DEBUG nova.network.neutron [req-feb97dab-c95c-403a-bfea-63d3129ba569 req-b428d2ed-7671-4e83-a3ef-67cdd36861c0 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:34:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-feb97dab-c95c-403a-bfea-63d3129ba569 req-b428d2ed-7671-4e83-a3ef-67cdd36861c0 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Detach interface failed, port_id=395eef1a-74ab-41c3-b9d0-db18c0cfbb82, reason: Instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:34:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:13 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:34:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-2bc4e608-958d-41e8-b0a0-6bf24b42e914 req-cb983247-4302-4f8a-b0e9-b25196a85696 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received event network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:34:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2bc4e608-958d-41e8-b0a0-6bf24b42e914 req-cb983247-4302-4f8a-b0e9-b25196a85696 service nova] Acquiring lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2bc4e608-958d-41e8-b0a0-6bf24b42e914 req-cb983247-4302-4f8a-b0e9-b25196a85696 service nova] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2bc4e608-958d-41e8-b0a0-6bf24b42e914 req-cb983247-4302-4f8a-b0e9-b25196a85696 service nova] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-2bc4e608-958d-41e8-b0a0-6bf24b42e914 req-cb983247-4302-4f8a-b0e9-b25196a85696 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] No waiting events found dispatching network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:34:13 user nova-compute[74681]: WARNING nova.compute.manager [req-2bc4e608-958d-41e8-b0a0-6bf24b42e914 req-cb983247-4302-4f8a-b0e9-b25196a85696 service nova] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Received unexpected event network-vif-plugged-395eef1a-74ab-41c3-b9d0-db18c0cfbb82 for instance with vm_state deleted and task_state None.
Aug 16 06:34:13 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:34:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:13 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Deleted allocations for instance 5fc4c990-cc82-410a-b3fc-f931aa20b9b3
Aug 16 06:34:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-21113a03-88c1-45c5-83c5-0073866cf368 tempest-ServerActionsTestOtherA-2037182259 tempest-ServerActionsTestOtherA-2037182259-project-member] Lock "5fc4c990-cc82-410a-b3fc-f931aa20b9b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.553s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:34:26 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167651.720772, 5fc4c990-cc82-410a-b3fc-f931aa20b9b3 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:34:26 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] VM Stopped (Lifecycle Event)
Aug 16 06:34:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-f9f9f61d-4c6a-4357-9703-0b7c598a0a89 None None] [instance: 5fc4c990-cc82-410a-b3fc-f931aa20b9b3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:34:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:34:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:34:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:34:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:34:42 user nova-compute[74681]: INFO nova.compute.manager [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Rescuing
Aug 16 06:34:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:34:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquired lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:34:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:34:42 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updating instance_info_cache with network_info: [{"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:34:42 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Releasing lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-5b3c1f10-3698-4a43-8a58-f3567d698752 req-71af9af1-73f4-4e2a-adaf-609752ecdaf0 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b3c1f10-3698-4a43-8a58-f3567d698752 req-71af9af1-73f4-4e2a-adaf-609752ecdaf0 service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b3c1f10-3698-4a43-8a58-f3567d698752 req-71af9af1-73f4-4e2a-adaf-609752ecdaf0 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5b3c1f10-3698-4a43-8a58-f3567d698752 req-71af9af1-73f4-4e2a-adaf-609752ecdaf0 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG nova.compute.manager [req-5b3c1f10-3698-4a43-8a58-f3567d698752 req-71af9af1-73f4-4e2a-adaf-609752ecdaf0 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:34:43 user nova-compute[74681]: WARNING nova.compute.manager [req-5b3c1f10-3698-4a43-8a58-f3567d698752 req-71af9af1-73f4-4e2a-adaf-609752ecdaf0 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state active and task_state rescuing.
Aug 16 06:34:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance destroyed successfully.
Aug 16 06:34:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Attempting a stable device rescue
Aug 16 06:34:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74681) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance directory exists: not creating {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 06:34:43 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Creating image(s)
Aug 16 06:34:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "/opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "/opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "624c7e55596011a39fcf4bb6ba75c05f175fc1ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:43 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "624c7e55596011a39fcf4bb6ba75c05f175fc1ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca.part --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG nova.virt.images [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] c2e7cdad-b245-45a3-bc37-067bc1c37b6d was qcow2, converting to raw {{(pid=74681) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG nova.privsep.utils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74681) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca.part /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca.converted {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-ed748b6e-15e2-4692-9b83-cac710a0124a req-ebab5203-2b68-4fd8-896c-aee9d2ff45bb service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ed748b6e-15e2-4692-9b83-cac710a0124a req-ebab5203-2b68-4fd8-896c-aee9d2ff45bb service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ed748b6e-15e2-4692-9b83-cac710a0124a req-ebab5203-2b68-4fd8-896c-aee9d2ff45bb service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ed748b6e-15e2-4692-9b83-cac710a0124a req-ebab5203-2b68-4fd8-896c-aee9d2ff45bb service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:45 user nova-compute[74681]: DEBUG nova.compute.manager [req-ed748b6e-15e2-4692-9b83-cac710a0124a req-ebab5203-2b68-4fd8-896c-aee9d2ff45bb service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:34:45 user nova-compute[74681]: WARNING nova.compute.manager [req-ed748b6e-15e2-4692-9b83-cac710a0124a req-ebab5203-2b68-4fd8-896c-aee9d2ff45bb service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state active and task_state rescuing.
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca.part /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca.converted" returned: 0 in 0.678s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca.converted --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "624c7e55596011a39fcf4bb6ba75c05f175fc1ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.559s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "624c7e55596011a39fcf4bb6ba75c05f175fc1ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "624c7e55596011a39fcf4bb6ba75c05f175fc1ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca --force-share --output=json" returned: 0 in 0.200s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca,backing_fmt=raw /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca,backing_fmt=raw /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue" returned: 0 in 0.050s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "624c7e55596011a39fcf4bb6ba75c05f175fc1ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'migration_context' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Start _get_guest_xml network_info=[{"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "vif_mac": "fa:16:3e:27:85:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c2e7cdad-b245-45a3-bc37-067bc1c37b6d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'd8cbf25a-bdc1-483f-9d11-bc60376a85de', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFBwkdLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a6ac7136-989e-4e7e-9efe-15d47bff5be3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd', 'serial': 'a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'resources' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'numa_topology' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:34:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:34:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFBwkdLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:34:46 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:34:46 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:34:46 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[343fb6ca-e861-4a9a-a2f4-39ff50bea2a9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gFBwkdLE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 06:34:46 user nova-compute[74681]: node.name = iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd
Aug 16 06:34:46 user nova-compute[74681]: node.tpgt = -1
Aug 16 06:34:46 user nova-compute[74681]: node.startup = automatic
Aug 16 06:34:46 user nova-compute[74681]: node.leading_login = No
Aug 16 06:34:46 user nova-compute[74681]: iface.iscsi_ifacename = default
Aug 16 06:34:46 user nova-compute[74681]: iface.net_ifacename = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.ipaddress = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.prefix_len = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.hwaddress = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.transport_name = tcp
Aug 16 06:34:46 user nova-compute[74681]: iface.initiatorname = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.state = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.vlan_id = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.vlan_priority = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.vlan_state = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.iface_num = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.mtu = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.port = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.bootproto = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.subnet_mask = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.gateway = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.dhcp_alt_client_id = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.dhcp_dns = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.dhcp_learn_iqn = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.dhcp_vendor_id_state = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.dhcp_vendor_id = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.dhcp_slp_da = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.fragmentation = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.gratuitous_arp = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.incoming_forwarding = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.tos_state = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.tos = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.ttl = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.delayed_ack = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.tcp_nagle = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.tcp_wsf_state = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.tcp_wsf = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.tcp_timer_scale = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.tcp_timestamp = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.redirect = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.def_task_mgmt_timeout = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.header_digest = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.data_digest = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.immediate_data = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.initial_r2t = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.data_seq_inorder = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.data_pdu_inorder = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.erl = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.max_receive_data_len = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.first_burst_len = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.max_outstanding_r2t = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.max_burst_len = 0
Aug 16 06:34:46 user nova-compute[74681]: iface.chap_auth = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.bidi_chap = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.strict_login_compliance = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.discovery_auth = <empty>
Aug 16 06:34:46 user nova-compute[74681]: iface.discovery_logout = <empty>
Aug 16 06:34:46 user nova-compute[74681]: node.discovery_address = <empty>
Aug 16 06:34:46 user nova-compute[74681]: node.discovery_port = 0
Aug 16 06:34:46 user nova-compute[74681]: node.discovery_type = static
Aug 16 06:34:46 user nova-compute[74681]: node.session.initial_cmdsn = 0
Aug 16 06:34:46 user nova-compute[74681]: node.session.initial_login_retry_max = 8
Aug 16 06:34:46 user nova-compute[74681]: node.session.xmit_thread_priority = -20
Aug 16 06:34:46 user nova-compute[74681]: node.session.cmds_max = 128
Aug 16 06:34:46 user nova-compute[74681]: node.session.queue_depth = 32
Aug 16 06:34:46 user nova-compute[74681]: node.session.nr_sessions = 1
Aug 16 06:34:46 user nova-compute[74681]: node.session.auth.authmethod = CHAP
Aug 16 06:34:46 user nova-compute[74681]: node.session.auth.username = gFBwkdLE
Aug 16 06:34:46 user nova-compute[74681]: node.session.auth.password = ***
Aug 16 06:34:46 user nova-compute[74681]: node.session.auth.username_in = <empty>
Aug 16 06:34:46 user nova-compute[74681]: node.session.auth.password_in = <empty>
Aug 16 06:34:46 user nova-compute[74681]: node.session.auth.chap_algs = MD5
Aug 16 06:34:46 user nova-compute[74681]: node.session.timeo.replacement_timeout = 120
Aug 16 06:34:46 user nova-compute[74681]: node.session.err_timeo.abort_timeout = 15
Aug 16 06:34:46 user nova-compute[74681]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 06:34:46 user nova-compute[74681]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 06:34:46 user nova-compute[74681]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.FastAbort = Yes
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.InitialR2T = No
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.ImmediateData = Yes
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.MaxConnections = 1
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 06:34:46 user nova-compute[74681]: node.session.iscsi.ERL = 0
Aug 16 06:34:46 user nova-compute[74681]: node.session.scan = manual
Aug 16 06:34:46 user nova-compute[74681]: node.session.reopen_max = 0
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].address = 172.16.0.220
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].port = 3260
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].startup = manual
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].tcp.window_size = 524288
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].tcp.type_of_service = 0
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].timeo.logout_timeout = 15
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].timeo.login_timeout = 15
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].timeo.auth_timeout = 45
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].iscsi.DataDigest = None
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].iscsi.IFMarker = No
Aug 16 06:34:46 user nova-compute[74681]: node.conn[0].iscsi.OFMarker = No
Aug 16 06:34:46 user nova-compute[74681]: # END RECORD
Aug 16 06:34:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[182b8302-5c54-4e59-8eca-c067b48cace1]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f46182-ac50-4035-9ccd-ca9361d0ef3d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFBwkdLE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFBwkdLE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aa3def-a34a-4d2a-a748-5f80c83924d0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gFBwkdLE'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2afb3b1-cb66-428e-814e-d1fb87d28cca]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c35685-b410-4029-9815-7d5b22af2a48]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:34:46 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:34:46 user nova-compute[74681]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:34:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:34:46 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:34:46 user nova-compute[74681]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:34:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] HCTL ('33', '0', '0', 0) found on session 48 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a918643-d6cb-4771-bd88-1a842a6261db]: (4, ('0 0 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Searching for a device in session 48 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFBwkdLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.185s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] <== connect_volume: return (187ms) {'type': 'block', 'scsi_wwn': '23664383838343139', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664383838343139', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-331157194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-331157194',id=45,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-yvpt7nfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:33:18Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=a6ac7136-989e-4e7e-9efe-15d47bff5be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "vif_mac": "fa:16:3e:27:85:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "vif_mac": "fa:16:3e:27:85:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:85:90,bridge_name='br-int',has_traffic_filtering=True,id=63d0691b-6e37-40ae-9807-8f63bfa0bf6d,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d0691b-6e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:34:46 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'pci_devices' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:34:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:34:47 user nova-compute[74681]:   <uuid>a6ac7136-989e-4e7e-9efe-15d47bff5be3</uuid>
Aug 16 06:34:47 user nova-compute[74681]:   <name>instance-0000002d</name>
Aug 16 06:34:47 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:34:47 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:34:47 user nova-compute[74681]:   <metadata>
Aug 16 06:34:47 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:34:47 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:34:47 user nova-compute[74681]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-331157194</nova:name>
Aug 16 06:34:47 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:34:46</nova:creationTime>
Aug 16 06:34:47 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:34:47 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:34:47 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:34:47 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:34:47 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:34:47 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:34:47 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:34:47 user nova-compute[74681]:       <nova:owner>
Aug 16 06:34:47 user nova-compute[74681]:         <nova:user uuid="361d070042c54dd59f7179619de1d1e9">tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member</nova:user>
Aug 16 06:34:47 user nova-compute[74681]:         <nova:project uuid="d289f0a66d5047b7b1be8ca5d969eaea">tempest-ServerBootFromVolumeStableRescueTest-2074839932</nova:project>
Aug 16 06:34:47 user nova-compute[74681]:       </nova:owner>
Aug 16 06:34:47 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:34:47 user nova-compute[74681]:       <nova:ports>
Aug 16 06:34:47 user nova-compute[74681]:         <nova:port uuid="63d0691b-6e37-40ae-9807-8f63bfa0bf6d">
Aug 16 06:34:47 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 06:34:47 user nova-compute[74681]:         </nova:port>
Aug 16 06:34:47 user nova-compute[74681]:       </nova:ports>
Aug 16 06:34:47 user nova-compute[74681]:     </nova:instance>
Aug 16 06:34:47 user nova-compute[74681]:   </metadata>
Aug 16 06:34:47 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:34:47 user nova-compute[74681]:     <system>
Aug 16 06:34:47 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:34:47 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:34:47 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:34:47 user nova-compute[74681]:       <entry name="serial">a6ac7136-989e-4e7e-9efe-15d47bff5be3</entry>
Aug 16 06:34:47 user nova-compute[74681]:       <entry name="uuid">a6ac7136-989e-4e7e-9efe-15d47bff5be3</entry>
Aug 16 06:34:47 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:34:47 user nova-compute[74681]:     </system>
Aug 16 06:34:47 user nova-compute[74681]:   </sysinfo>
Aug 16 06:34:47 user nova-compute[74681]:   <os>
Aug 16 06:34:47 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:34:47 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:34:47 user nova-compute[74681]:   </os>
Aug 16 06:34:47 user nova-compute[74681]:   <features>
Aug 16 06:34:47 user nova-compute[74681]:     <acpi/>
Aug 16 06:34:47 user nova-compute[74681]:     <apic/>
Aug 16 06:34:47 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:34:47 user nova-compute[74681]:   </features>
Aug 16 06:34:47 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:34:47 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:34:47 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:34:47 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:34:47 user nova-compute[74681]:   </clock>
Aug 16 06:34:47 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:34:47 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:34:47 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:34:47 user nova-compute[74681]:   </cpu>
Aug 16 06:34:47 user nova-compute[74681]:   <devices>
Aug 16 06:34:47 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:34:47 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:34:47 user nova-compute[74681]:       <source dev="/dev/sdb"/>
Aug 16 06:34:47 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:34:47 user nova-compute[74681]:       <serial>a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd</serial>
Aug 16 06:34:47 user nova-compute[74681]:     </disk>
Aug 16 06:34:47 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:34:47 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:34:47 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue"/>
Aug 16 06:34:47 user nova-compute[74681]:       <target dev="vdb" bus="virtio"/>
Aug 16 06:34:47 user nova-compute[74681]:       <boot order="1"/>
Aug 16 06:34:47 user nova-compute[74681]:     </disk>
Aug 16 06:34:47 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:34:47 user nova-compute[74681]:       <mac address="fa:16:3e:27:85:90"/>
Aug 16 06:34:47 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:34:47 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:34:47 user nova-compute[74681]:       <target dev="tap63d0691b-6e"/>
Aug 16 06:34:47 user nova-compute[74681]:     </interface>
Aug 16 06:34:47 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:34:47 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/console.log" append="off"/>
Aug 16 06:34:47 user nova-compute[74681]:     </serial>
Aug 16 06:34:47 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:34:47 user nova-compute[74681]:     <video>
Aug 16 06:34:47 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:34:47 user nova-compute[74681]:     </video>
Aug 16 06:34:47 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:34:47 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:34:47 user nova-compute[74681]:     </rng>
Aug 16 06:34:47 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:34:47 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:34:47 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:34:47 user nova-compute[74681]:     </memballoon>
Aug 16 06:34:47 user nova-compute[74681]:   </devices>
Aug 16 06:34:47 user nova-compute[74681]: </domain>
Aug 16 06:34:47 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:34:47 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance destroyed successfully.
Aug 16 06:34:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:34:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:34:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] No VIF found with MAC fa:16:3e:27:85:90, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-070b27a5-2500-48b9-8e5b-84a1ada87c6b req-952d0eae-3179-4812-bc03-06dc5b62a08a service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-070b27a5-2500-48b9-8e5b-84a1ada87c6b req-952d0eae-3179-4812-bc03-06dc5b62a08a service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-070b27a5-2500-48b9-8e5b-84a1ada87c6b req-952d0eae-3179-4812-bc03-06dc5b62a08a service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-070b27a5-2500-48b9-8e5b-84a1ada87c6b req-952d0eae-3179-4812-bc03-06dc5b62a08a service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-070b27a5-2500-48b9-8e5b-84a1ada87c6b req-952d0eae-3179-4812-bc03-06dc5b62a08a service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:34:48 user nova-compute[74681]: WARNING nova.compute.manager [req-070b27a5-2500-48b9-8e5b-84a1ada87c6b req-952d0eae-3179-4812-bc03-06dc5b62a08a service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state active and task_state rescuing.
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-764a18f3-04fd-4732-ace5-2c709597a912 req-85a811d2-9d3c-4ebf-bc8b-801dfc50ac6f service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-764a18f3-04fd-4732-ace5-2c709597a912 req-85a811d2-9d3c-4ebf-bc8b-801dfc50ac6f service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-764a18f3-04fd-4732-ace5-2c709597a912 req-85a811d2-9d3c-4ebf-bc8b-801dfc50ac6f service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-764a18f3-04fd-4732-ace5-2c709597a912 req-85a811d2-9d3c-4ebf-bc8b-801dfc50ac6f service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-764a18f3-04fd-4732-ace5-2c709597a912 req-85a811d2-9d3c-4ebf-bc8b-801dfc50ac6f service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:34:50 user nova-compute[74681]: WARNING nova.compute.manager [req-764a18f3-04fd-4732-ace5-2c709597a912 req-85a811d2-9d3c-4ebf-bc8b-801dfc50ac6f service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state active and task_state rescuing.
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for a6ac7136-989e-4e7e-9efe-15d47bff5be3 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167690.7948394, a6ac7136-989e-4e7e-9efe-15d47bff5be3 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:34:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] VM Resumed (Lifecycle Event)
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2fcabac4-a77d-4c1b-a709-bf53a4157b10 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:34:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167690.7957783, a6ac7136-989e-4e7e-9efe-15d47bff5be3 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:34:50 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] VM Started (Lifecycle Event)
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:34:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:34:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:34:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8105MB free_disk=25.00652313232422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a6ac7136-989e-4e7e-9efe-15d47bff5be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:34:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:34:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:34:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:34:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:34:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:34:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 31137824-5fa9-44e3-86ca-5d0587c28454 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updating instance_info_cache with network_info: [{"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:59 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:34:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:35:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-d975c3f9-dba0-4ad8-ba2b-1967068097b8 req-f31e5b7e-4f25-4716-b886-99b7162755ad service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received event network-changed-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-d975c3f9-dba0-4ad8-ba2b-1967068097b8 req-f31e5b7e-4f25-4716-b886-99b7162755ad service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Refreshing instance network info cache due to event network-changed-1e041cfa-15f0-4569-8a0f-7e129055d5b4. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:35:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d975c3f9-dba0-4ad8-ba2b-1967068097b8 req-f31e5b7e-4f25-4716-b886-99b7162755ad service nova] Acquiring lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:35:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d975c3f9-dba0-4ad8-ba2b-1967068097b8 req-f31e5b7e-4f25-4716-b886-99b7162755ad service nova] Acquired lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:35:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-d975c3f9-dba0-4ad8-ba2b-1967068097b8 req-f31e5b7e-4f25-4716-b886-99b7162755ad service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Refreshing network info cache for port 1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:35:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-d975c3f9-dba0-4ad8-ba2b-1967068097b8 req-f31e5b7e-4f25-4716-b886-99b7162755ad service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Updated VIF entry in instance network info cache for port 1e041cfa-15f0-4569-8a0f-7e129055d5b4. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:35:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-d975c3f9-dba0-4ad8-ba2b-1967068097b8 req-f31e5b7e-4f25-4716-b886-99b7162755ad service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Updating instance_info_cache with network_info: [{"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:35:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d975c3f9-dba0-4ad8-ba2b-1967068097b8 req-f31e5b7e-4f25-4716-b886-99b7162755ad service nova] Releasing lock "refresh_cache-fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:35:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:10 user nova-compute[74681]: INFO nova.compute.manager [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Terminating instance
Aug 16 06:35:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:35:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-0757b551-f66a-4e36-a1a4-e5082aade8da req-447c479c-148c-4c93-b48e-5dab5cbcef4c service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received event network-vif-unplugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0757b551-f66a-4e36-a1a4-e5082aade8da req-447c479c-148c-4c93-b48e-5dab5cbcef4c service nova] Acquiring lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0757b551-f66a-4e36-a1a4-e5082aade8da req-447c479c-148c-4c93-b48e-5dab5cbcef4c service nova] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0757b551-f66a-4e36-a1a4-e5082aade8da req-447c479c-148c-4c93-b48e-5dab5cbcef4c service nova] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-0757b551-f66a-4e36-a1a4-e5082aade8da req-447c479c-148c-4c93-b48e-5dab5cbcef4c service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] No waiting events found dispatching network-vif-unplugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-0757b551-f66a-4e36-a1a4-e5082aade8da req-447c479c-148c-4c93-b48e-5dab5cbcef4c service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received event network-vif-unplugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:11 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Instance destroyed successfully.
Aug 16 06:35:11 user nova-compute[74681]: DEBUG nova.objects.instance [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'resources' on Instance uuid fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-963071475',display_name='tempest-TestVolumeBootPattern-server-963071475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-963071475',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:33:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-p9ehy0e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:33:33Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "address": "fa:16:3e:b3:2b:e2", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e041cfa-15", "ovs_interfaceid": "1e041cfa-15f0-4569-8a0f-7e129055d5b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=1e041cfa-15f0-4569-8a0f-7e129055d5b4,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e041cfa-15') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_vif [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=1e041cfa-15f0-4569-8a0f-7e129055d5b4,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e041cfa-15') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e041cfa-15, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:35:11 user nova-compute[74681]: INFO os_vif [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=1e041cfa-15f0-4569-8a0f-7e129055d5b4,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e041cfa-15')
Aug 16 06:35:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovRBMXix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:35:11 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[25978d37-cf01-47ec-aa2e-f69099f2ad8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae4e9c-6b1b-43c0-a221-9276b6484e9b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:35:11 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:35:11 user nova-compute[74681]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:35:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:35:11 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:35:11 user nova-compute[74681]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:35:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94842e1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba85194f-d670-4f9a-ad81-5f2484185af2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.053s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b310859-5e43-4979-840e-67fefae1ee9c]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[81930828-3f6e-4d60-aa8a-a6472ee6eaea]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:35:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd9f33-7074-40a6-8406-c826133aa604]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f15d12b6', '/dev/disk/by-id/scsi-1SCST_BIOf15d12b6-f7f3e2749d00c67d', '/dev/disk/by-id/scsi-26637663365323734') {{(pid=121298) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4011d4e8-1658-4d6f-9247-78b883e25714]: (4, None) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bb789c-b8bd-4216-9fd2-571a40809e00]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[00976b6c-408f-4726-b88f-df954f5158a9]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260]
Aug 16 06:35:12 user nova-compute[74681]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260] successful.
Aug 16 06:35:12 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e74b90-5d91-4b71-9eca-581328ee91af]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== disconnect_volume: return (442ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:35:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Deleting instance files /opt/stack/data/nova/instances/fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e_del
Aug 16 06:35:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Deletion of /opt/stack/data/nova/instances/fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e_del complete
Aug 16 06:35:12 user nova-compute[74681]: INFO nova.compute.manager [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 16 06:35:12 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:35:12 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:35:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ff9fbec-61c6-4f13-b247-9b9ec3c29ae3 req-ff680a08-13b5-4df1-8d93-e817b08fcd6d service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received event network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ff9fbec-61c6-4f13-b247-9b9ec3c29ae3 req-ff680a08-13b5-4df1-8d93-e817b08fcd6d service nova] Acquiring lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ff9fbec-61c6-4f13-b247-9b9ec3c29ae3 req-ff680a08-13b5-4df1-8d93-e817b08fcd6d service nova] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-2ff9fbec-61c6-4f13-b247-9b9ec3c29ae3 req-ff680a08-13b5-4df1-8d93-e817b08fcd6d service nova] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-2ff9fbec-61c6-4f13-b247-9b9ec3c29ae3 req-ff680a08-13b5-4df1-8d93-e817b08fcd6d service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] No waiting events found dispatching network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:35:13 user nova-compute[74681]: WARNING nova.compute.manager [req-2ff9fbec-61c6-4f13-b247-9b9ec3c29ae3 req-ff680a08-13b5-4df1-8d93-e817b08fcd6d service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received unexpected event network-vif-plugged-1e041cfa-15f0-4569-8a0f-7e129055d5b4 for instance with vm_state active and task_state deleting.
Aug 16 06:35:13 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:35:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-4ad8ecbb-729a-4a72-b77c-91dc6256832b req-00012410-124c-47db-beba-aa016459cbb6 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Received event network-vif-deleted-1e041cfa-15f0-4569-8a0f-7e129055d5b4 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:14 user nova-compute[74681]: INFO nova.compute.manager [req-4ad8ecbb-729a-4a72-b77c-91dc6256832b req-00012410-124c-47db-beba-aa016459cbb6 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Neutron deleted interface 1e041cfa-15f0-4569-8a0f-7e129055d5b4; detaching it from the instance and deleting it from the info cache
Aug 16 06:35:14 user nova-compute[74681]: DEBUG nova.network.neutron [req-4ad8ecbb-729a-4a72-b77c-91dc6256832b req-00012410-124c-47db-beba-aa016459cbb6 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:35:14 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Took 1.69 seconds to deallocate network for instance.
Aug 16 06:35:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-4ad8ecbb-729a-4a72-b77c-91dc6256832b req-00012410-124c-47db-beba-aa016459cbb6 service nova] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Detach interface failed, port_id=1e041cfa-15f0-4569-8a0f-7e129055d5b4, reason: Instance fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:35:15 user nova-compute[74681]: INFO nova.compute.manager [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Took 1.76 seconds to detach 1 volumes for instance.
Aug 16 06:35:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:16 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Deleted allocations for instance fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-88e7c4be-e684-4c77-8049-52a02ffc94ac tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.514s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG nova.objects.instance [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'flavor' on Instance uuid 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:16 user nova-compute[74681]: INFO nova.compute.manager [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Attaching volume c730887e-7cf4-4277-a012-7e847b26bb70 to /dev/vdb
Aug 16 06:35:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG os_brick.utils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4024d8b-caa1-4869-92ac-2e23247b5a2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df441f3-63ad-4daa-a3c7-92599d817d3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4185245-bb97-43c8-828a-1b6c77dfabdb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[179abe3e-4078-48d5-b07c-07a127461f59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:35:16 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:35:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f062f8c-2739-420b-9fcd-8c515a9af45f]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG os_brick.utils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:35:16 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating existing volume attachment record: 007ace66-b12a-49cc-8e2c-d88b2fa9ff63 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:35:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfRyYGxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:35:26 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:35:26 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:35:26 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f8fc42-aaec-4c62-806d-0adc0bb63003]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:35:26 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fc9bd2-fea4-4878-bf8b-b3d70d97e4bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70] added
Aug 16 06:35:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090514d-26c8-4025-9f01-5171fc519828]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d80754-9333-4431-809e-abc309c23901]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfRyYGxQ {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfRyYGxQ" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b276acfa-bc4d-4992-999e-cb226087ae26]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfRyYGxQ'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[437751df-b947-4585-863e-0fd77515cfdf]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bfc507-2dc4-4460-a570-f01238b02911]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:35:26 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:35:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:35:26 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:35:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd992690-90d9-4d66-8e6c-32312bb8908e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70, portal: 172.16.0.220,3260]
Aug 16 06:35:26 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70, portal: 172.16.0.220,3260] successful.
Aug 16 06:35:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1796a1-e734-476f-9c11-e84505944a81]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65fe3ac-181c-43de-b3a0-d2cbddbe793a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:35:26 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:35:26 user nova-compute[74681]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)
Aug 16 06:35:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:35:26 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:35:26 user nova-compute[74681]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)
Aug 16 06:35:26 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed73755-6131-4d65-853c-cb97ec5d0266]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfRyYGxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167711.6850133, fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:35:26 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] VM Stopped (Lifecycle Event)
Aug 16 06:35:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-e7d0041d-216b-480a-921f-13ab99634987 None None] [instance: fcf9ac9f-384e-46eb-8e50-b6a3c1ea152e] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:35:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:35:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23935323164633838', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:35:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935323164633838', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:35:27 user nova-compute[74681]: DEBUG nova.objects.instance [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'flavor' on Instance uuid 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:35:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:35:27 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:35:27 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:35:27 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:35:27 user nova-compute[74681]:   <serial>c730887e-7cf4-4277-a012-7e847b26bb70</serial>
Aug 16 06:35:27 user nova-compute[74681]: </disk>
Aug 16 06:35:27 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:35:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:35:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:35:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] No VIF found with MAC fa:16:3e:43:9e:14, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:35:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-362f53be-cc5e-4bc9-af2f-dc78407d6cca tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.701s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-7da45671-1e8e-4a1d-8d55-49200b5a069b req-76c5fca4-c1bd-4936-9400-4a7ec561fcdf service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-7da45671-1e8e-4a1d-8d55-49200b5a069b req-76c5fca4-c1bd-4936-9400-4a7ec561fcdf service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing instance network info cache due to event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7da45671-1e8e-4a1d-8d55-49200b5a069b req-76c5fca4-c1bd-4936-9400-4a7ec561fcdf service nova] Acquiring lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7da45671-1e8e-4a1d-8d55-49200b5a069b req-76c5fca4-c1bd-4936-9400-4a7ec561fcdf service nova] Acquired lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-7da45671-1e8e-4a1d-8d55-49200b5a069b req-76c5fca4-c1bd-4936-9400-4a7ec561fcdf service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-7da45671-1e8e-4a1d-8d55-49200b5a069b req-76c5fca4-c1bd-4936-9400-4a7ec561fcdf service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updated VIF entry in instance network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-7da45671-1e8e-4a1d-8d55-49200b5a069b req-76c5fca4-c1bd-4936-9400-4a7ec561fcdf service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating instance_info_cache with network_info: [{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:35:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7da45671-1e8e-4a1d-8d55-49200b5a069b req-76c5fca4-c1bd-4936-9400-4a7ec561fcdf service nova] Releasing lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:35:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-7cceb3ad-82f4-4918-9f53-5828f6279a7c req-b58148d9-758a-4dba-b172-7bef1c7e1bfa service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:33 user nova-compute[74681]: DEBUG nova.compute.manager [req-7cceb3ad-82f4-4918-9f53-5828f6279a7c req-b58148d9-758a-4dba-b172-7bef1c7e1bfa service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing instance network info cache due to event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:35:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7cceb3ad-82f4-4918-9f53-5828f6279a7c req-b58148d9-758a-4dba-b172-7bef1c7e1bfa service nova] Acquiring lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:35:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7cceb3ad-82f4-4918-9f53-5828f6279a7c req-b58148d9-758a-4dba-b172-7bef1c7e1bfa service nova] Acquired lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:35:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-7cceb3ad-82f4-4918-9f53-5828f6279a7c req-b58148d9-758a-4dba-b172-7bef1c7e1bfa service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:35:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-7cceb3ad-82f4-4918-9f53-5828f6279a7c req-b58148d9-758a-4dba-b172-7bef1c7e1bfa service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updated VIF entry in instance network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:35:33 user nova-compute[74681]: DEBUG nova.network.neutron [req-7cceb3ad-82f4-4918-9f53-5828f6279a7c req-b58148d9-758a-4dba-b172-7bef1c7e1bfa service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating instance_info_cache with network_info: [{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:35:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7cceb3ad-82f4-4918-9f53-5828f6279a7c req-b58148d9-758a-4dba-b172-7bef1c7e1bfa service nova] Releasing lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:35:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:34 user nova-compute[74681]: INFO nova.compute.manager [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Rebooting instance
Aug 16 06:35:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:35:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquired lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:35:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:35:34 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating instance_info_cache with network_info: [{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:35:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Releasing lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:35:34 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:35:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2553566-603c-4a29-9ef9-491d38eb4fc9 req-71f59e7f-28c4-425d-921c-69a639ad29a7 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2553566-603c-4a29-9ef9-491d38eb4fc9 req-71f59e7f-28c4-425d-921c-69a639ad29a7 service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2553566-603c-4a29-9ef9-491d38eb4fc9 req-71f59e7f-28c4-425d-921c-69a639ad29a7 service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c2553566-603c-4a29-9ef9-491d38eb4fc9 req-71f59e7f-28c4-425d-921c-69a639ad29a7 service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-c2553566-603c-4a29-9ef9-491d38eb4fc9 req-71f59e7f-28c4-425d-921c-69a639ad29a7 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:35:37 user nova-compute[74681]: WARNING nova.compute.manager [req-c2553566-603c-4a29-9ef9-491d38eb4fc9 req-71f59e7f-28c4-425d-921c-69a639ad29a7 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state active and task_state reboot_started.
Aug 16 06:35:37 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Instance shutdown successfully.
Aug 16 06:35:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-640f2e1e-700c-4b41-9e42-c60555e5fa6b req-5b66526e-75ed-42b2-a677-a15a69b4ff6a service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-640f2e1e-700c-4b41-9e42-c60555e5fa6b req-5b66526e-75ed-42b2-a677-a15a69b4ff6a service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-640f2e1e-700c-4b41-9e42-c60555e5fa6b req-5b66526e-75ed-42b2-a677-a15a69b4ff6a service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-640f2e1e-700c-4b41-9e42-c60555e5fa6b req-5b66526e-75ed-42b2-a677-a15a69b4ff6a service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG nova.compute.manager [req-640f2e1e-700c-4b41-9e42-c60555e5fa6b req-5b66526e-75ed-42b2-a677-a15a69b4ff6a service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:35:39 user nova-compute[74681]: WARNING nova.compute.manager [req-640f2e1e-700c-4b41-9e42-c60555e5fa6b req-5b66526e-75ed-42b2-a677-a15a69b4ff6a service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state active and task_state reboot_started.
Aug 16 06:35:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:39 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:35:41 user nova-compute[74681]: WARNING nova.compute.manager [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state active and task_state reboot_started.
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:35:41 user nova-compute[74681]: WARNING nova.compute.manager [req-71872774-4682-4e9a-aa71-23981bb83d3c req-cbda2756-764d-4037-a8a1-2012afb38b4b service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state active and task_state reboot_started.
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167741.5121381, 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:35:41 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] VM Resumed (Lifecycle Event)
Aug 16 06:35:41 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Instance running successfully.
Aug 16 06:35:41 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Instance soft rebooted successfully.
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:35:41 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167741.5161266, 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:35:41 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] VM Started (Lifecycle Event)
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b5cb5f9b-6319-4f51-9a9e-76aed1d82f4a tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.593s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:49 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:50 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:35:51 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:35:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8086MB free_disk=24.998661041259766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a6ac7136-989e-4e7e-9efe-15d47bff5be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:35:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:35:52 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:35:52 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:35:52 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:35:52 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:55 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:35:56 user nova-compute[74681]: INFO nova.compute.claims [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Claim successful on node user
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Refreshing inventories for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Updating ProviderTree inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Refreshing aggregate associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, aggregates: None {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Refreshing trait associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.network.neutron [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:56 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.policy [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edc23f0062344c7a84bd576e41ef67f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f67a11fca845049b48179f437addac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:35:56 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Creating image(s)
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "/opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "/opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.202s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk 1073741824" returned: 0 in 0.050s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG nova.network.neutron [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Successfully created port: b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Cannot resize image /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lazy-loading 'migration_context' on Instance uuid b5738c6f-58a1-4659-8331-1141c0fea1cf {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Ensure instance console log exists: /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:35:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Successfully updated port: b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquired lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-7062139c-f179-4fb7-8bcb-a7968f490ddc req-b3efa345-bf63-492a-a333-9017f46611ba service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received event network-changed-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG nova.compute.manager [req-7062139c-f179-4fb7-8bcb-a7968f490ddc req-b3efa345-bf63-492a-a333-9017f46611ba service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Refreshing instance network info cache due to event network-changed-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7062139c-f179-4fb7-8bcb-a7968f490ddc req-b3efa345-bf63-492a-a333-9017f46611ba service nova] Acquiring lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:35:58 user nova-compute[74681]: DEBUG nova.network.neutron [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.network.neutron [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Updating instance_info_cache with network_info: [{"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Releasing lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Instance network_info: |[{"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7062139c-f179-4fb7-8bcb-a7968f490ddc req-b3efa345-bf63-492a-a333-9017f46611ba service nova] Acquired lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.network.neutron [req-7062139c-f179-4fb7-8bcb-a7968f490ddc req-b3efa345-bf63-492a-a333-9017f46611ba service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Refreshing network info cache for port b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Start _get_guest_xml network_info=[{"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:35:59 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:35:59 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1851544835',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1851544835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1851544',id=48,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGusim1gPlJ6m/HxHUcDJm8r4V9RKhJol8NwYWA6+10Ku4b968xeCGtLvimgnBrQpaQWBaUxCwKV+pGlaDnGbA5IKIYi4mMC6tgTve/qEbsfUM8MKmdfhrxXCPLC/PxEZg==',key_name='tempest-keypair-1382469024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f67a11fca845049b48179f437addac',ramdisk_id='',reservation_id='r-1993lihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-456051724',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc23f0062344c7a84bd576e41ef67f9',uuid=b5738c6f-58a1-4659-8331-1141c0fea1cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Converting VIF {"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:29:12,bridge_name='br-int',has_traffic_filtering=True,id=b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a,network=Network(41b2150f-a735-47ad-b888-68dcb267cdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f8c1d9-3d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.objects.instance [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lazy-loading 'pci_devices' on Instance uuid b5738c6f-58a1-4659-8331-1141c0fea1cf {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:35:59 user nova-compute[74681]:   <uuid>b5738c6f-58a1-4659-8331-1141c0fea1cf</uuid>
Aug 16 06:35:59 user nova-compute[74681]:   <name>instance-00000030</name>
Aug 16 06:35:59 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:35:59 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:35:59 user nova-compute[74681]:   <metadata>
Aug 16 06:35:59 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:35:59 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:35:59 user nova-compute[74681]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1851544835</nova:name>
Aug 16 06:35:59 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:35:59</nova:creationTime>
Aug 16 06:35:59 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:35:59 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:35:59 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:35:59 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:35:59 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:35:59 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:35:59 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:35:59 user nova-compute[74681]:       <nova:owner>
Aug 16 06:35:59 user nova-compute[74681]:         <nova:user uuid="edc23f0062344c7a84bd576e41ef67f9">tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member</nova:user>
Aug 16 06:35:59 user nova-compute[74681]:         <nova:project uuid="f9f67a11fca845049b48179f437addac">tempest-TestServerVolumeAttachScenarioOldVersion-456051724</nova:project>
Aug 16 06:35:59 user nova-compute[74681]:       </nova:owner>
Aug 16 06:35:59 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:35:59 user nova-compute[74681]:       <nova:ports>
Aug 16 06:35:59 user nova-compute[74681]:         <nova:port uuid="b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a">
Aug 16 06:35:59 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 06:35:59 user nova-compute[74681]:         </nova:port>
Aug 16 06:35:59 user nova-compute[74681]:       </nova:ports>
Aug 16 06:35:59 user nova-compute[74681]:     </nova:instance>
Aug 16 06:35:59 user nova-compute[74681]:   </metadata>
Aug 16 06:35:59 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:35:59 user nova-compute[74681]:     <system>
Aug 16 06:35:59 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:35:59 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:35:59 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:35:59 user nova-compute[74681]:       <entry name="serial">b5738c6f-58a1-4659-8331-1141c0fea1cf</entry>
Aug 16 06:35:59 user nova-compute[74681]:       <entry name="uuid">b5738c6f-58a1-4659-8331-1141c0fea1cf</entry>
Aug 16 06:35:59 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:35:59 user nova-compute[74681]:     </system>
Aug 16 06:35:59 user nova-compute[74681]:   </sysinfo>
Aug 16 06:35:59 user nova-compute[74681]:   <os>
Aug 16 06:35:59 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:35:59 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:35:59 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:35:59 user nova-compute[74681]:   </os>
Aug 16 06:35:59 user nova-compute[74681]:   <features>
Aug 16 06:35:59 user nova-compute[74681]:     <acpi/>
Aug 16 06:35:59 user nova-compute[74681]:     <apic/>
Aug 16 06:35:59 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:35:59 user nova-compute[74681]:   </features>
Aug 16 06:35:59 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:35:59 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:35:59 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:35:59 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:35:59 user nova-compute[74681]:   </clock>
Aug 16 06:35:59 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:35:59 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:35:59 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:35:59 user nova-compute[74681]:   </cpu>
Aug 16 06:35:59 user nova-compute[74681]:   <devices>
Aug 16 06:35:59 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:35:59 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:35:59 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk"/>
Aug 16 06:35:59 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:35:59 user nova-compute[74681]:     </disk>
Aug 16 06:35:59 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:35:59 user nova-compute[74681]:       <mac address="fa:16:3e:5a:29:12"/>
Aug 16 06:35:59 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:35:59 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:35:59 user nova-compute[74681]:       <target dev="tapb1f8c1d9-3d"/>
Aug 16 06:35:59 user nova-compute[74681]:     </interface>
Aug 16 06:35:59 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:35:59 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/console.log" append="off"/>
Aug 16 06:35:59 user nova-compute[74681]:     </serial>
Aug 16 06:35:59 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:35:59 user nova-compute[74681]:     <video>
Aug 16 06:35:59 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:35:59 user nova-compute[74681]:     </video>
Aug 16 06:35:59 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:35:59 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:35:59 user nova-compute[74681]:     </rng>
Aug 16 06:35:59 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:35:59 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:35:59 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:35:59 user nova-compute[74681]:     </memballoon>
Aug 16 06:35:59 user nova-compute[74681]:   </devices>
Aug 16 06:35:59 user nova-compute[74681]: </domain>
Aug 16 06:35:59 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1851544835',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1851544835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1851544',id=48,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGusim1gPlJ6m/HxHUcDJm8r4V9RKhJol8NwYWA6+10Ku4b968xeCGtLvimgnBrQpaQWBaUxCwKV+pGlaDnGbA5IKIYi4mMC6tgTve/qEbsfUM8MKmdfhrxXCPLC/PxEZg==',key_name='tempest-keypair-1382469024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f67a11fca845049b48179f437addac',ramdisk_id='',reservation_id='r-1993lihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-456051724',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc23f0062344c7a84bd576e41ef67f9',uuid=b5738c6f-58a1-4659-8331-1141c0fea1cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Converting VIF {"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:29:12,bridge_name='br-int',has_traffic_filtering=True,id=b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a,network=Network(41b2150f-a735-47ad-b888-68dcb267cdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f8c1d9-3d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG os_vif [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:29:12,bridge_name='br-int',has_traffic_filtering=True,id=b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a,network=Network(41b2150f-a735-47ad-b888-68dcb267cdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f8c1d9-3d') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1f8c1d9-3d, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1f8c1d9-3d, col_values=(('external_ids', {'iface-id': 'b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:29:12', 'vm-uuid': 'b5738c6f-58a1-4659-8331-1141c0fea1cf'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:35:59 user nova-compute[74681]: INFO os_vif [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:29:12,bridge_name='br-int',has_traffic_filtering=True,id=b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a,network=Network(41b2150f-a735-47ad-b888-68dcb267cdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f8c1d9-3d')
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:35:59 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] No VIF found with MAC fa:16:3e:5a:29:12, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updating instance_info_cache with network_info: [{"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG nova.network.neutron [req-7062139c-f179-4fb7-8bcb-a7968f490ddc req-b3efa345-bf63-492a-a333-9017f46611ba service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Updated VIF entry in instance network info cache for port b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG nova.network.neutron [req-7062139c-f179-4fb7-8bcb-a7968f490ddc req-b3efa345-bf63-492a-a333-9017f46611ba service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Updating instance_info_cache with network_info: [{"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-b581cf93-c19c-4d1f-a000-113a548ee755" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7062139c-f179-4fb7-8bcb-a7968f490ddc req-b3efa345-bf63-492a-a333-9017f46611ba service nova] Releasing lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-cade4320-b6da-402a-a648-898ebb7e7aea req-32a41690-bd2a-4a20-9a1d-0d0a06c590f6 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received event network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cade4320-b6da-402a-a648-898ebb7e7aea req-32a41690-bd2a-4a20-9a1d-0d0a06c590f6 service nova] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cade4320-b6da-402a-a648-898ebb7e7aea req-32a41690-bd2a-4a20-9a1d-0d0a06c590f6 service nova] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-cade4320-b6da-402a-a648-898ebb7e7aea req-32a41690-bd2a-4a20-9a1d-0d0a06c590f6 service nova] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG nova.compute.manager [req-cade4320-b6da-402a-a648-898ebb7e7aea req-32a41690-bd2a-4a20-9a1d-0d0a06c590f6 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] No waiting events found dispatching network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:36:01 user nova-compute[74681]: WARNING nova.compute.manager [req-cade4320-b6da-402a-a648-898ebb7e7aea req-32a41690-bd2a-4a20-9a1d-0d0a06c590f6 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received unexpected event network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a for instance with vm_state building and task_state spawning.
Aug 16 06:36:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:36:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:02 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:36:02 user nova-compute[74681]: INFO nova.compute.claims [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Claim successful on node user
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-a13eef76-eac4-46a6-8ae7-36de752ebaa7 req-b6b92d3a-748f-4d50-a52c-6127b0b58dde service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received event network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a13eef76-eac4-46a6-8ae7-36de752ebaa7 req-b6b92d3a-748f-4d50-a52c-6127b0b58dde service nova] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a13eef76-eac4-46a6-8ae7-36de752ebaa7 req-b6b92d3a-748f-4d50-a52c-6127b0b58dde service nova] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a13eef76-eac4-46a6-8ae7-36de752ebaa7 req-b6b92d3a-748f-4d50-a52c-6127b0b58dde service nova] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-a13eef76-eac4-46a6-8ae7-36de752ebaa7 req-b6b92d3a-748f-4d50-a52c-6127b0b58dde service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] No waiting events found dispatching network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:36:03 user nova-compute[74681]: WARNING nova.compute.manager [req-a13eef76-eac4-46a6-8ae7-36de752ebaa7 req-b6b92d3a-748f-4d50-a52c-6127b0b58dde service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received unexpected event network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a for instance with vm_state building and task_state spawning.
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167763.3052862, b5738c6f-58a1-4659-8331-1141c0fea1cf => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] VM Resumed (Lifecycle Event)
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Instance spawned successfully.
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167763.308675, b5738c6f-58a1-4659-8331-1141c0fea1cf => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] VM Started (Lifecycle Event)
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.network.neutron [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.virt.block_device [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Booting with volume 4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 at /dev/vda
Aug 16 06:36:03 user nova-compute[74681]: INFO nova.compute.manager [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Took 7.53 seconds to build instance.
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-18f89448-8095-4217-9223-d1d7c9330303 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.633s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.policy [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd0444b91944ba5b2d1e3c852456964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbdfedd72a4b38aaa5acd93ac18163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG os_brick.utils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fcb770-f69a-4455-9899-a5b03e27239a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[97738e1f-bd1b-4f1e-a767-80d58e6b0303]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a6a951-d814-4d34-813a-d969783d0d12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ae8d5-fcdc-426a-94a3-4bc516df18f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:36:03 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:36:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c3ef14-e588-427a-a88c-869154f0b8d2]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG os_brick.utils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:36:03 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updating existing volume attachment record: 3f2f7d51-59d7-4fc1-85e2-6789ded47f0c {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:36:04 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:04 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 06:36:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] There are 1 instances to clean {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 06:36:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance has had 4 of 5 cleanup attempts {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11142}}
Aug 16 06:36:04 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Deletion of /opt/stack/data/nova/instances/70390b89-fdfb-4552-98e5-35568c0268bc_resize failed
Aug 16 06:36:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:04 user nova-compute[74681]: DEBUG nova.network.neutron [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Successfully created port: 6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:36:04 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Successfully updated port: 6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:36:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:36:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquired lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:36:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:36:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-108a8d35-6ccf-4b70-abae-5776f5d33988 req-ad5467af-1cd3-4782-9eeb-caa5d1bec251 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-changed-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-108a8d35-6ccf-4b70-abae-5776f5d33988 req-ad5467af-1cd3-4782-9eeb-caa5d1bec251 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Refreshing instance network info cache due to event network-changed-6d3cb2c3-d799-454b-b948-4344f2bbcf56. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:36:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-108a8d35-6ccf-4b70-abae-5776f5d33988 req-ad5467af-1cd3-4782-9eeb-caa5d1bec251 service nova] Acquiring lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:36:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updating instance_info_cache with network_info: [{"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Releasing lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Instance network_info: |[{"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-108a8d35-6ccf-4b70-abae-5776f5d33988 req-ad5467af-1cd3-4782-9eeb-caa5d1bec251 service nova] Acquired lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-108a8d35-6ccf-4b70-abae-5776f5d33988 req-ad5467af-1cd3-4782-9eeb-caa5d1bec251 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Refreshing network info cache for port 6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-108a8d35-6ccf-4b70-abae-5776f5d33988 req-ad5467af-1cd3-4782-9eeb-caa5d1bec251 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updated VIF entry in instance network info cache for port 6d3cb2c3-d799-454b-b948-4344f2bbcf56. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-108a8d35-6ccf-4b70-abae-5776f5d33988 req-ad5467af-1cd3-4782-9eeb-caa5d1bec251 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updating instance_info_cache with network_info: [{"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-108a8d35-6ccf-4b70-abae-5776f5d33988 req-ad5467af-1cd3-4782-9eeb-caa5d1bec251 service nova] Releasing lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:36:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:13 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74681) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:36:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Creating image(s)
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Ensure instance console log exists: /opt/stack/data/nova/instances/1ed765f9-44f0-4aa2-aafc-92aa54a4d348/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Start _get_guest_xml network_info=[{"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '3f2f7d51-59d7-4fc1-85e2-6789ded47f0c', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovRBMXix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ed765f9-44f0-4aa2-aafc-92aa54a4d348', 'attached_at': '', 'detached_at': '', 'volume_id': '4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9', 'serial': '4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:36:14 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:36:14 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovRBMXix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:36:14 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:36:14 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:36:14 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:36:14 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eb0b48-b1c1-4444-a0a1-2d8b7e63ab1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:36:14 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75a9859-ce31-41ab-b6d3-17d76bbb93d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9] added
Aug 16 06:36:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[518186e8-610a-420c-8904-1c0313d4460d]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[34171cbd-66c1-4816-9e80-c59e24ab470e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovRBMXix {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovRBMXix" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[484139ca-f081-44fa-9639-b37527d0905e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ovRBMXix'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[25842597-46a4-4056-9f5e-cc39bc27ea1e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b08ecef-7007-4e65-890b-e292af819f93]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba099ae-54a7-4c50-bb13-f91cab8834b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260]
Aug 16 06:36:14 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260] successful.
Aug 16 06:36:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4031e1b-01aa-4cbf-b2a7-2940fb580d48]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b44b2ef-d1b6-42da-a8af-794e39f3c435]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:36:14 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fbba65-bbcc-49dc-92b2-dd0c5536fb2a]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:36:14 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovRBMXix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26637663365323734', 'path': '/dev/sde'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637663365323734', 'path': '/dev/sde'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577201711',display_name='tempest-TestVolumeBootPattern-server-1577201711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577201711',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-q64r2w00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:36:04Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=1ed765f9-44f0-4aa2-aafc-92aa54a4d348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:87,bridge_name='br-int',has_traffic_filtering=True,id=6d3cb2c3-d799-454b-b948-4344f2bbcf56,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3cb2c3-d7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:36:15 user nova-compute[74681]:   <uuid>1ed765f9-44f0-4aa2-aafc-92aa54a4d348</uuid>
Aug 16 06:36:15 user nova-compute[74681]:   <name>instance-00000031</name>
Aug 16 06:36:15 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:36:15 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:36:15 user nova-compute[74681]:   <metadata>
Aug 16 06:36:15 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:36:15 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:36:15 user nova-compute[74681]:       <nova:name>tempest-TestVolumeBootPattern-server-1577201711</nova:name>
Aug 16 06:36:15 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:36:14</nova:creationTime>
Aug 16 06:36:15 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:36:15 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:36:15 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:36:15 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:36:15 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:36:15 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:36:15 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:36:15 user nova-compute[74681]:       <nova:owner>
Aug 16 06:36:15 user nova-compute[74681]:         <nova:user uuid="efd0444b91944ba5b2d1e3c852456964">tempest-TestVolumeBootPattern-702107063-project-member</nova:user>
Aug 16 06:36:15 user nova-compute[74681]:         <nova:project uuid="3fbbdfedd72a4b38aaa5acd93ac18163">tempest-TestVolumeBootPattern-702107063</nova:project>
Aug 16 06:36:15 user nova-compute[74681]:       </nova:owner>
Aug 16 06:36:15 user nova-compute[74681]:       <nova:ports>
Aug 16 06:36:15 user nova-compute[74681]:         <nova:port uuid="6d3cb2c3-d799-454b-b948-4344f2bbcf56">
Aug 16 06:36:15 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:36:15 user nova-compute[74681]:         </nova:port>
Aug 16 06:36:15 user nova-compute[74681]:       </nova:ports>
Aug 16 06:36:15 user nova-compute[74681]:     </nova:instance>
Aug 16 06:36:15 user nova-compute[74681]:   </metadata>
Aug 16 06:36:15 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:36:15 user nova-compute[74681]:     <system>
Aug 16 06:36:15 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:36:15 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:36:15 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:36:15 user nova-compute[74681]:       <entry name="serial">1ed765f9-44f0-4aa2-aafc-92aa54a4d348</entry>
Aug 16 06:36:15 user nova-compute[74681]:       <entry name="uuid">1ed765f9-44f0-4aa2-aafc-92aa54a4d348</entry>
Aug 16 06:36:15 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:36:15 user nova-compute[74681]:     </system>
Aug 16 06:36:15 user nova-compute[74681]:   </sysinfo>
Aug 16 06:36:15 user nova-compute[74681]:   <os>
Aug 16 06:36:15 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:36:15 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:36:15 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:36:15 user nova-compute[74681]:   </os>
Aug 16 06:36:15 user nova-compute[74681]:   <features>
Aug 16 06:36:15 user nova-compute[74681]:     <acpi/>
Aug 16 06:36:15 user nova-compute[74681]:     <apic/>
Aug 16 06:36:15 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:36:15 user nova-compute[74681]:   </features>
Aug 16 06:36:15 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:36:15 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:36:15 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:36:15 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:36:15 user nova-compute[74681]:   </clock>
Aug 16 06:36:15 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:36:15 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:36:15 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:36:15 user nova-compute[74681]:   </cpu>
Aug 16 06:36:15 user nova-compute[74681]:   <devices>
Aug 16 06:36:15 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:36:15 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:36:15 user nova-compute[74681]:       <source dev="/dev/sde"/>
Aug 16 06:36:15 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:36:15 user nova-compute[74681]:       <serial>4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9</serial>
Aug 16 06:36:15 user nova-compute[74681]:     </disk>
Aug 16 06:36:15 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:36:15 user nova-compute[74681]:       <mac address="fa:16:3e:77:1f:87"/>
Aug 16 06:36:15 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:36:15 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:36:15 user nova-compute[74681]:       <target dev="tap6d3cb2c3-d7"/>
Aug 16 06:36:15 user nova-compute[74681]:     </interface>
Aug 16 06:36:15 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:36:15 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/1ed765f9-44f0-4aa2-aafc-92aa54a4d348/console.log" append="off"/>
Aug 16 06:36:15 user nova-compute[74681]:     </serial>
Aug 16 06:36:15 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:36:15 user nova-compute[74681]:     <video>
Aug 16 06:36:15 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:36:15 user nova-compute[74681]:     </video>
Aug 16 06:36:15 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:36:15 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:36:15 user nova-compute[74681]:     </rng>
Aug 16 06:36:15 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:36:15 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:36:15 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:36:15 user nova-compute[74681]:     </memballoon>
Aug 16 06:36:15 user nova-compute[74681]:   </devices>
Aug 16 06:36:15 user nova-compute[74681]: </domain>
Aug 16 06:36:15 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577201711',display_name='tempest-TestVolumeBootPattern-server-1577201711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577201711',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-q64r2w00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:36:04Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=1ed765f9-44f0-4aa2-aafc-92aa54a4d348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:87,bridge_name='br-int',has_traffic_filtering=True,id=6d3cb2c3-d799-454b-b948-4344f2bbcf56,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3cb2c3-d7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG os_vif [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:87,bridge_name='br-int',has_traffic_filtering=True,id=6d3cb2c3-d799-454b-b948-4344f2bbcf56,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3cb2c3-d7') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d3cb2c3-d7, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d3cb2c3-d7, col_values=(('external_ids', {'iface-id': '6d3cb2c3-d799-454b-b948-4344f2bbcf56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:1f:87', 'vm-uuid': '1ed765f9-44f0-4aa2-aafc-92aa54a4d348'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:36:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:15 user nova-compute[74681]: INFO os_vif [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:87,bridge_name='br-int',has_traffic_filtering=True,id=6d3cb2c3-d799-454b-b948-4344f2bbcf56,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3cb2c3-d7')
Aug 16 06:36:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:36:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No VIF found with MAC fa:16:3e:77:1f:87, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:36:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-24c1d654-cf01-490f-aad1-0b680372787e req-f9f2c917-97f5-4cc3-9373-9e4baf5173b4 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-24c1d654-cf01-490f-aad1-0b680372787e req-f9f2c917-97f5-4cc3-9373-9e4baf5173b4 service nova] Acquiring lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-24c1d654-cf01-490f-aad1-0b680372787e req-f9f2c917-97f5-4cc3-9373-9e4baf5173b4 service nova] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-24c1d654-cf01-490f-aad1-0b680372787e req-f9f2c917-97f5-4cc3-9373-9e4baf5173b4 service nova] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-24c1d654-cf01-490f-aad1-0b680372787e req-f9f2c917-97f5-4cc3-9373-9e4baf5173b4 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] No waiting events found dispatching network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:36:17 user nova-compute[74681]: WARNING nova.compute.manager [req-24c1d654-cf01-490f-aad1-0b680372787e req-f9f2c917-97f5-4cc3-9373-9e4baf5173b4 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received unexpected event network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 for instance with vm_state building and task_state spawning.
Aug 16 06:36:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167779.7825384, 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:36:19 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] VM Resumed (Lifecycle Event)
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:36:19 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Instance spawned successfully.
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:36:19 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167779.7828903, 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:36:19 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] VM Started (Lifecycle Event)
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-908d4797-1235-4022-a674-2cef682f7829 req-eb07c253-167f-4196-becc-cfee6da02aee service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-908d4797-1235-4022-a674-2cef682f7829 req-eb07c253-167f-4196-becc-cfee6da02aee service nova] Acquiring lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-908d4797-1235-4022-a674-2cef682f7829 req-eb07c253-167f-4196-becc-cfee6da02aee service nova] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-908d4797-1235-4022-a674-2cef682f7829 req-eb07c253-167f-4196-becc-cfee6da02aee service nova] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.compute.manager [req-908d4797-1235-4022-a674-2cef682f7829 req-eb07c253-167f-4196-becc-cfee6da02aee service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] No waiting events found dispatching network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:36:19 user nova-compute[74681]: WARNING nova.compute.manager [req-908d4797-1235-4022-a674-2cef682f7829 req-eb07c253-167f-4196-becc-cfee6da02aee service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received unexpected event network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 for instance with vm_state building and task_state spawning.
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:36:19 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:36:19 user nova-compute[74681]: INFO nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Took 5.52 seconds to spawn the instance on the hypervisor.
Aug 16 06:36:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:20 user nova-compute[74681]: INFO nova.compute.manager [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Took 17.09 seconds to build instance.
Aug 16 06:36:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-64bae70d-0e1e-4ccb-848a-c60a731263f3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.225s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:33 user nova-compute[74681]: INFO nova.compute.manager [None req-c072d54d-3022-41bd-8fc3-a1c819bc6a4f tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Unrescuing
Aug 16 06:36:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c072d54d-3022-41bd-8fc3-a1c819bc6a4f tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:36:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c072d54d-3022-41bd-8fc3-a1c819bc6a4f tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquired lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:36:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-c072d54d-3022-41bd-8fc3-a1c819bc6a4f tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:36:33 user nova-compute[74681]: DEBUG nova.network.neutron [None req-c072d54d-3022-41bd-8fc3-a1c819bc6a4f tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updating instance_info_cache with network_info: [{"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:36:33 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-c072d54d-3022-41bd-8fc3-a1c819bc6a4f tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Releasing lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:36:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-c072d54d-3022-41bd-8fc3-a1c819bc6a4f tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'flavor' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:36:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c1ef9f4d-8505-47fd-ac12-0eee9fb131cc req-61dbb3fc-da85-4d23-bf28-4dd04907fd38 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1ef9f4d-8505-47fd-ac12-0eee9fb131cc req-61dbb3fc-da85-4d23-bf28-4dd04907fd38 service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1ef9f4d-8505-47fd-ac12-0eee9fb131cc req-61dbb3fc-da85-4d23-bf28-4dd04907fd38 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:34 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c1ef9f4d-8505-47fd-ac12-0eee9fb131cc req-61dbb3fc-da85-4d23-bf28-4dd04907fd38 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:34 user nova-compute[74681]: DEBUG nova.compute.manager [req-c1ef9f4d-8505-47fd-ac12-0eee9fb131cc req-61dbb3fc-da85-4d23-bf28-4dd04907fd38 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:36:34 user nova-compute[74681]: WARNING nova.compute.manager [req-c1ef9f4d-8505-47fd-ac12-0eee9fb131cc req-61dbb3fc-da85-4d23-bf28-4dd04907fd38 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:36:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:34 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance destroyed successfully.
Aug 16 06:36:35 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 31137824-5fa9-44e3-86ca-5d0587c28454 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid b5738c6f-58a1-4659-8331-1141c0fea1cf {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Triggering sync for uuid 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 {{(pid=74681) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "31137824-5fa9-44e3-86ca-5d0587c28454" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "b581cf93-c19c-4d1f-a000-113a548ee755" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: INFO nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "31137824-5fa9-44e3-86ca-5d0587c28454" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "b581cf93-c19c-4d1f-a000-113a548ee755" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:36:36 user nova-compute[74681]: WARNING nova.compute.manager [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG nova.compute.manager [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:36:36 user nova-compute[74681]: WARNING nova.compute.manager [req-dc09361d-fb93-4bfa-8819-5644923b397b req-29ffcece-5ac8-43b9-b178-08859e9f7e84 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state rescued and task_state unrescuing.
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:37 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Removed pending event for a6ac7136-989e-4e7e-9efe-15d47bff5be3 due to event {{(pid=74681) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 06:36:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167797.9391484, a6ac7136-989e-4e7e-9efe-15d47bff5be3 => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:36:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] VM Resumed (Lifecycle Event)
Aug 16 06:36:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c072d54d-3022-41bd-8fc3-a1c819bc6a4f tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:36:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 06:36:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167797.940281, a6ac7136-989e-4e7e-9efe-15d47bff5be3 => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:36:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] VM Started (Lifecycle Event)
Aug 16 06:36:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:36:38 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:36:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-d0c935cc-e3a2-4ba8-b475-244dd0772dbc req-90a45d38-a035-4a4b-87da-e10f09173e87 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:36:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d0c935cc-e3a2-4ba8-b475-244dd0772dbc req-90a45d38-a035-4a4b-87da-e10f09173e87 service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d0c935cc-e3a2-4ba8-b475-244dd0772dbc req-90a45d38-a035-4a4b-87da-e10f09173e87 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-d0c935cc-e3a2-4ba8-b475-244dd0772dbc req-90a45d38-a035-4a4b-87da-e10f09173e87 service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-d0c935cc-e3a2-4ba8-b475-244dd0772dbc req-90a45d38-a035-4a4b-87da-e10f09173e87 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:36:38 user nova-compute[74681]: WARNING nova.compute.manager [req-d0c935cc-e3a2-4ba8-b475-244dd0772dbc req-90a45d38-a035-4a4b-87da-e10f09173e87 service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state active and task_state None.
Aug 16 06:36:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:50 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:51 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:36:52 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:36:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:36:53 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=24.95879364013672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a6ac7136-989e-4e7e-9efe-15d47bff5be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b5738c6f-58a1-4659-8331-1141c0fea1cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:36:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:36:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:36:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:36:59 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Updating instance_info_cache with network_info: [{"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:37:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:03 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:37:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:10 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-6186ed1c-b4c4-4a0a-bc21-41a0096f3fe2 req-c6eed6a1-20d1-415a-a59b-0115f16a9e17 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:37:25 user nova-compute[74681]: DEBUG nova.compute.manager [req-6186ed1c-b4c4-4a0a-bc21-41a0096f3fe2 req-c6eed6a1-20d1-415a-a59b-0115f16a9e17 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing instance network info cache due to event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:37:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6186ed1c-b4c4-4a0a-bc21-41a0096f3fe2 req-c6eed6a1-20d1-415a-a59b-0115f16a9e17 service nova] Acquiring lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:37:25 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6186ed1c-b4c4-4a0a-bc21-41a0096f3fe2 req-c6eed6a1-20d1-415a-a59b-0115f16a9e17 service nova] Acquired lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:37:25 user nova-compute[74681]: DEBUG nova.network.neutron [req-6186ed1c-b4c4-4a0a-bc21-41a0096f3fe2 req-c6eed6a1-20d1-415a-a59b-0115f16a9e17 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:37:26 user nova-compute[74681]: DEBUG nova.network.neutron [req-6186ed1c-b4c4-4a0a-bc21-41a0096f3fe2 req-c6eed6a1-20d1-415a-a59b-0115f16a9e17 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updated VIF entry in instance network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:37:26 user nova-compute[74681]: DEBUG nova.network.neutron [req-6186ed1c-b4c4-4a0a-bc21-41a0096f3fe2 req-c6eed6a1-20d1-415a-a59b-0115f16a9e17 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating instance_info_cache with network_info: [{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:37:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-6186ed1c-b4c4-4a0a-bc21-41a0096f3fe2 req-c6eed6a1-20d1-415a-a59b-0115f16a9e17 service nova] Releasing lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:37:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-525b8534-9e79-4e79-a361-68fa605de8a7 req-05ed458c-f9c4-4ee4-aa52-b056fcc08402 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.compute.manager [req-525b8534-9e79-4e79-a361-68fa605de8a7 req-05ed458c-f9c4-4ee4-aa52-b056fcc08402 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing instance network info cache due to event network-changed-8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-525b8534-9e79-4e79-a361-68fa605de8a7 req-05ed458c-f9c4-4ee4-aa52-b056fcc08402 service nova] Acquiring lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-525b8534-9e79-4e79-a361-68fa605de8a7 req-05ed458c-f9c4-4ee4-aa52-b056fcc08402 service nova] Acquired lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-525b8534-9e79-4e79-a361-68fa605de8a7 req-05ed458c-f9c4-4ee4-aa52-b056fcc08402 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Refreshing network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:37:27 user nova-compute[74681]: INFO nova.compute.manager [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Detaching volume c730887e-7cf4-4277-a012-7e847b26bb70
Aug 16 06:37:27 user nova-compute[74681]: INFO nova.virt.block_device [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Attempting to driver detach volume c730887e-7cf4-4277-a012-7e847b26bb70 from mountpoint /dev/vdb
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Attempting to detach device vdb from instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:37:27 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:37:27 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:37:27 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:37:27 user nova-compute[74681]:   <serial>c730887e-7cf4-4277-a012-7e847b26bb70</serial>
Aug 16 06:37:27 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:37:27 user nova-compute[74681]: </disk>
Aug 16 06:37:27 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:37:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully detached device vdb from instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc from the persistent domain config.
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:37:27 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:37:27 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:37:27 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:37:27 user nova-compute[74681]:   <serial>c730887e-7cf4-4277-a012-7e847b26bb70</serial>
Aug 16 06:37:27 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:37:27 user nova-compute[74681]: </disk>
Aug 16 06:37:27 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-525b8534-9e79-4e79-a361-68fa605de8a7 req-05ed458c-f9c4-4ee4-aa52-b056fcc08402 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updated VIF entry in instance network info cache for port 8e510d87-d382-4e3b-b684-aca0fed10cec. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.network.neutron [req-525b8534-9e79-4e79-a361-68fa605de8a7 req-05ed458c-f9c4-4ee4-aa52-b056fcc08402 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating instance_info_cache with network_info: [{"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-525b8534-9e79-4e79-a361-68fa605de8a7 req-05ed458c-f9c4-4ee4-aa52-b056fcc08402 service nova] Releasing lock "refresh_cache-8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167847.7772317, 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:37:27 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully detached device vdb from instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc from the live domain config.
Aug 16 06:37:27 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfRyYGxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:37:27 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[336d47d1-ac6b-404a-ad29-7febddae88ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[31028df4-2f5a-426f-9d5f-1cd83f44cdaa]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:37:27 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:37:27 user nova-compute[74681]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)
Aug 16 06:37:27 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:37:27 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:37:27 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:37:27 user nova-compute[74681]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 (non-flash)
Aug 16 06:37:27 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:37:27 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9494353be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b9f88d-5661-4341-8808-07b2a18284d1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2793df-abb6-4542-a374-6200afb11048]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6788fca1-8db0-4519-b165-590e4d696f84]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[86178341-151c-4bf7-9f8c-e34299eaf49e]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f22ee3-6fb3-47c5-9d87-ef7342cd55c6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:37:27 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a90f8a-5bb1-43f2-8db6-abc969d029b4]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70, portal: 172.16.0.220,3260]
Aug 16 06:37:28 user nova-compute[74681]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70, portal: 172.16.0.220,3260] successful.
Aug 16 06:37:28 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c730887e-7cf4-4277-a012-7e847b26bb70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a18600-0b1c-4d63-9fdd-79bf12a5b101]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] <== disconnect_volume: return (288ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG nova.objects.instance [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'flavor' on Instance uuid 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:37:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-5a61cd69-33c3-4bbf-834e-6939a9d9a8bd tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.743s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:37:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:37:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:37:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:37:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-4a90251a-74ef-4086-bdd0-84870ea3a69f req-90ff55d0-2246-4737-9c99-e0c8f7a3752a service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received event network-changed-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:37:47 user nova-compute[74681]: DEBUG nova.compute.manager [req-4a90251a-74ef-4086-bdd0-84870ea3a69f req-90ff55d0-2246-4737-9c99-e0c8f7a3752a service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Refreshing instance network info cache due to event network-changed-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:37:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4a90251a-74ef-4086-bdd0-84870ea3a69f req-90ff55d0-2246-4737-9c99-e0c8f7a3752a service nova] Acquiring lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:37:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4a90251a-74ef-4086-bdd0-84870ea3a69f req-90ff55d0-2246-4737-9c99-e0c8f7a3752a service nova] Acquired lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:37:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-4a90251a-74ef-4086-bdd0-84870ea3a69f req-90ff55d0-2246-4737-9c99-e0c8f7a3752a service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Refreshing network info cache for port b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:37:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-4a90251a-74ef-4086-bdd0-84870ea3a69f req-90ff55d0-2246-4737-9c99-e0c8f7a3752a service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Updated VIF entry in instance network info cache for port b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:37:47 user nova-compute[74681]: DEBUG nova.network.neutron [req-4a90251a-74ef-4086-bdd0-84870ea3a69f req-90ff55d0-2246-4737-9c99-e0c8f7a3752a service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Updating instance_info_cache with network_info: [{"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:37:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4a90251a-74ef-4086-bdd0-84870ea3a69f req-90ff55d0-2246-4737-9c99-e0c8f7a3752a service nova] Releasing lock "refresh_cache-b5738c6f-58a1-4659-8331-1141c0fea1cf" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:37:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:51 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:53 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG nova.compute.manager [req-efffad85-a95c-4190-82d1-db690446f2ae req-572b75fb-1d95-4780-8fc5-e8fae6ae4002 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-changed-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG nova.compute.manager [req-efffad85-a95c-4190-82d1-db690446f2ae req-572b75fb-1d95-4780-8fc5-e8fae6ae4002 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Refreshing instance network info cache due to event network-changed-6d3cb2c3-d799-454b-b948-4344f2bbcf56. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efffad85-a95c-4190-82d1-db690446f2ae req-572b75fb-1d95-4780-8fc5-e8fae6ae4002 service nova] Acquiring lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efffad85-a95c-4190-82d1-db690446f2ae req-572b75fb-1d95-4780-8fc5-e8fae6ae4002 service nova] Acquired lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG nova.network.neutron [req-efffad85-a95c-4190-82d1-db690446f2ae req-572b75fb-1d95-4780-8fc5-e8fae6ae4002 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Refreshing network info cache for port 6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:55 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:37:55 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7988MB free_disk=24.9564208984375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance a6ac7136-989e-4e7e-9efe-15d47bff5be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b5738c6f-58a1-4659-8331-1141c0fea1cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.network.neutron [req-efffad85-a95c-4190-82d1-db690446f2ae req-572b75fb-1d95-4780-8fc5-e8fae6ae4002 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updated VIF entry in instance network info cache for port 6d3cb2c3-d799-454b-b948-4344f2bbcf56. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.network.neutron [req-efffad85-a95c-4190-82d1-db690446f2ae req-572b75fb-1d95-4780-8fc5-e8fae6ae4002 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updating instance_info_cache with network_info: [{"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-efffad85-a95c-4190-82d1-db690446f2ae req-572b75fb-1d95-4780-8fc5-e8fae6ae4002 service nova] Releasing lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:37:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:37:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:37:56 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lazy-loading 'flavor' on Instance uuid b5738c6f-58a1-4659-8331-1141c0fea1cf {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:37:57 user nova-compute[74681]: INFO nova.compute.manager [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Attaching volume db7fa739-a754-47e1-9883-efb1dd4e9849 to /dev/vdb
Aug 16 06:37:57 user nova-compute[74681]: DEBUG os_brick.utils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f4b88a-a50f-4da5-b8b6-768d97c3dd6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced9914-5094-4c50-992a-f2ea5fc9f3c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867d281-f239-4f79-a071-a91cf43b8c74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[599e4d81-46d9-4192-97f5-bc1be86f6921]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:37:57 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:37:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9f41ff-c57e-43e2-bc88-ae1c4a3bcc0c]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG os_brick.utils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:37:57 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Updating existing volume attachment record: 894692a9-5d06-4c59-9ea5-53b370567b3a {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:37:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:37:59 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:38:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:38:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:38:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:38:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:38:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:38:02 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:38:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:03 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updating instance_info_cache with network_info: [{"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:38:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-a6ac7136-989e-4e7e-9efe-15d47bff5be3" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:38:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:38:03 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:38:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:38:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:38:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfdRDxJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:38:07 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:38:07 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:38:07 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b38cd0-3b20-4f2b-9f96-6e321f390198]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:38:07 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69dd67d-2163-449f-9114-317548de529b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849] added
Aug 16 06:38:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e8d24e-3556-46fa-823a-92e361478522]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0a1878-7836-4f06-a902-a4f62fc8afc3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfdRDxJu {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfdRDxJu" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c9c969-9129-4e85-bfb7-606a034e2e88]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VfdRDxJu'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cf5b13-54fc-4078-acf9-0a48780b0a99]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba30624-eb3a-47e5-b128-8d31e55e7b79]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e53b729-ed5c-4c39-9e9d-89a89a9b38e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849, portal: 172.16.0.220,3260]
Aug 16 06:38:07 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849, portal: 172.16.0.220,3260] successful.
Aug 16 06:38:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adb6ef6-1cb1-403c-9cd0-97ffac7367e5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5048e9-6f7a-4091-a6d8-813a23348331]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 (non-flash)
Aug 16 06:38:07 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fd70da-098e-47f0-967a-fad5fc682519]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:38:07 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfdRDxJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26164393734643037', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164393734643037', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lazy-loading 'flavor' on Instance uuid b5738c6f-58a1-4659-8331-1141c0fea1cf {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:38:08 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:38:08 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:38:08 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:38:08 user nova-compute[74681]:   <serial>db7fa739-a754-47e1-9883-efb1dd4e9849</serial>
Aug 16 06:38:08 user nova-compute[74681]: </disk>
Aug 16 06:38:08 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] No VIF found with MAC fa:16:3e:5a:29:12, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1893e366-acf5-441d-a8b5-200d5eb98fb0 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.740s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:10 user nova-compute[74681]: INFO nova.compute.manager [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Detaching volume db7fa739-a754-47e1-9883-efb1dd4e9849
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:38:10 user nova-compute[74681]: INFO nova.compute.claims [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Claim successful on node user
Aug 16 06:38:10 user nova-compute[74681]: INFO nova.virt.block_device [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Attempting to driver detach volume db7fa739-a754-47e1-9883-efb1dd4e9849 from mountpoint /dev/vdb
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Attempting to detach device vdb from instance b5738c6f-58a1-4659-8331-1141c0fea1cf from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:38:10 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:38:10 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:38:10 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:38:10 user nova-compute[74681]:   <serial>db7fa739-a754-47e1-9883-efb1dd4e9849</serial>
Aug 16 06:38:10 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:38:10 user nova-compute[74681]: </disk>
Aug 16 06:38:10 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:38:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Successfully detached device vdb from instance b5738c6f-58a1-4659-8331-1141c0fea1cf from the persistent domain config.
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5738c6f-58a1-4659-8331-1141c0fea1cf from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:38:10 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:38:10 user nova-compute[74681]:   <source dev="/dev/sdd"/>
Aug 16 06:38:10 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:38:10 user nova-compute[74681]:   <serial>db7fa739-a754-47e1-9883-efb1dd4e9849</serial>
Aug 16 06:38:10 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:38:10 user nova-compute[74681]: </disk>
Aug 16 06:38:10 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:38:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692167890.8238919, b5738c6f-58a1-4659-8331-1141c0fea1cf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5738c6f-58a1-4659-8331-1141c0fea1cf {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:38:10 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Successfully detached device vdb from instance b5738c6f-58a1-4659-8331-1141c0fea1cf from the live domain config.
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfdRDxJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:38:10 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG nova.policy [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efd0444b91944ba5b2d1e3c852456964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbdfedd72a4b38aaa5acd93ac18163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0636c-2143-424e-9b48-e9fce9547d3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:10 user nova-compute[74681]: INFO nova.virt.block_device [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Booting with volume 77ce380e-c30a-4071-8ef0-7ff2e57f97f9 at /dev/vda
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd4e9f0-84f8-4a53-807d-ffd404170f1d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:10 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:10 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:10 user nova-compute[74681]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 (non-flash)
Aug 16 06:38:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:10 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:10 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:10 user nova-compute[74681]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 (non-flash)
Aug 16 06:38:10 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948475e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb68bb-3a26-4ea0-9ed8-582740923897]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f8ab7d-1d5d-4eea-9954-9dc497bfe232]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.utils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[397856c7-3868-4c61-ab62-5b88d73ed334]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:10 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7167d191-db02-444b-a6b6-c5d71b514c5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e96f301-7f2e-4ec0-a226-605acefb0c35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7c3f32-c20d-418a-b6fe-e229267d83a2]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[faedb96f-af9b-459d-b8e5-b1ed8f40e20c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040bbfa-adb4-4d8a-9a3f-23e0aad6aec6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4aafee-1b16-46cd-8d74-bc37cd23d826]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:38:11 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9617a3-36bf-42ab-9eac-50084e1e7bb4]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.utils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updating existing volume attachment record: c503b6bf-c302-4a58-88b5-3932ea017806 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9fd23e-74f4-4bd9-91eb-a5a1202b22b5]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849, portal: 172.16.0.220,3260]
Aug 16 06:38:11 user nova-compute[74681]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849, portal: 172.16.0.220,3260] successful.
Aug 16 06:38:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7fa739-a754-47e1-9883-efb1dd4e9849 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[69abb7d5-25e6-4451-ac19-70e3584bd11b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] <== disconnect_volume: return (387ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Successfully created port: e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:38:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG nova.objects.instance [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lazy-loading 'flavor' on Instance uuid b5738c6f-58a1-4659-8331-1141c0fea1cf {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-e297fe9c-d409-428e-9522-b857760a0aad tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.905s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Successfully updated port: e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquired lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-34b0e393-eb6c-41f8-a782-9a6ee45051ec req-60511089-87dd-4a09-bbc8-3ff2318f1bec service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-changed-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-34b0e393-eb6c-41f8-a782-9a6ee45051ec req-60511089-87dd-4a09-bbc8-3ff2318f1bec service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Refreshing instance network info cache due to event network-changed-e8740382-21b9-480f-bb54-749e6923d77e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-34b0e393-eb6c-41f8-a782-9a6ee45051ec req-60511089-87dd-4a09-bbc8-3ff2318f1bec service nova] Acquiring lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:38:12 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG nova.network.neutron [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updating instance_info_cache with network_info: [{"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Releasing lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Instance network_info: |[{"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-34b0e393-eb6c-41f8-a782-9a6ee45051ec req-60511089-87dd-4a09-bbc8-3ff2318f1bec service nova] Acquired lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG nova.network.neutron [req-34b0e393-eb6c-41f8-a782-9a6ee45051ec req-60511089-87dd-4a09-bbc8-3ff2318f1bec service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Refreshing network info cache for port e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG nova.network.neutron [req-34b0e393-eb6c-41f8-a782-9a6ee45051ec req-60511089-87dd-4a09-bbc8-3ff2318f1bec service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updated VIF entry in instance network info cache for port e8740382-21b9-480f-bb54-749e6923d77e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG nova.network.neutron [req-34b0e393-eb6c-41f8-a782-9a6ee45051ec req-60511089-87dd-4a09-bbc8-3ff2318f1bec service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updating instance_info_cache with network_info: [{"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-34b0e393-eb6c-41f8-a782-9a6ee45051ec req-60511089-87dd-4a09-bbc8-3ff2318f1bec service nova] Releasing lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:38:14 user nova-compute[74681]: INFO nova.compute.claims [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Claim successful on node user
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.network.neutron [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:38:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.policy [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8531a2b8138744d98b13b3cbdcd0c62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddf2ada3a5e4457b79cab432befc5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:38:14 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Creating image(s)
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "/opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "/opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:14 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk 1073741824 {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe,backing_fmt=raw /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk 1073741824" returned: 0 in 0.067s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "13fc9a78cd830755a2fc6e7257a733567ae84bfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk. size=1073741824 {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG nova.network.neutron [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Successfully created port: 4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG nova.virt.disk.api [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Cannot resize image /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk to a smaller size. {{(pid=74681) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'migration_context' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Created local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Ensure instance console log exists: /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.neutron [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Successfully updated port: 4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquired lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.neutron [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-a6a73d7f-0e57-4fe4-9d3c-4fb4225a1fb2 req-30ae6000-85a6-4a80-a098-6eb28b10f37a service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received event network-changed-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-a6a73d7f-0e57-4fe4-9d3c-4fb4225a1fb2 req-30ae6000-85a6-4a80-a098-6eb28b10f37a service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Refreshing instance network info cache due to event network-changed-4138d117-4f17-46a5-868b-bf6f2c031f68. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a6a73d7f-0e57-4fe4-9d3c-4fb4225a1fb2 req-30ae6000-85a6-4a80-a098-6eb28b10f37a service nova] Acquiring lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.neutron [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.neutron [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Releasing lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Instance network_info: |[{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a6a73d7f-0e57-4fe4-9d3c-4fb4225a1fb2 req-30ae6000-85a6-4a80-a098-6eb28b10f37a service nova] Acquired lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.neutron [req-a6a73d7f-0e57-4fe4-9d3c-4fb4225a1fb2 req-30ae6000-85a6-4a80-a098-6eb28b10f37a service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Refreshing network info cache for port 4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Start _get_guest_xml network_info=[{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '89d7f25c-29d1-41cf-9690-6814b446c3b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:38:16 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:38:16 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T06:05:57Z,direct_url=<?>,disk_format='qcow2',id=89d7f25c-29d1-41cf-9690-6814b446c3b9,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1efa6da603c04f6daaa6b9826ef50543',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T06:05:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-482528149',display_name='tempest-SnapshotDataIntegrityTests-server-482528149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-482528149',id=51,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4519zWBhP/u0wLmhoUh7ctSS0WiRmRfFWqPHdk8pKQV8DvWTb2isn008J+YbXShTzFJ1+5LNzhYZ39N+ffSOlkoQnO+WB/ToS/OqtX41NehsnUjVf60PkvOFM6zkAa1Q==',key_name='tempest-keypair-699899462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ddf2ada3a5e4457b79cab432befc5e9',ramdisk_id='',reservation_id='r-ibxkk12x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1703853827',owner_user_name='tempest-SnapshotDataIntegrityTests-1703853827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:38:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8531a2b8138744d98b13b3cbdcd0c62c',uuid=5dbdce7a-d331-435f-8dd3-d192b8ce7d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Converting VIF {"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=4138d117-4f17-46a5-868b-bf6f2c031f68,network=Network(7740c34e-0b66-4d60-9956-f4c65cd48b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138d117-4f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.objects.instance [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:38:16 user nova-compute[74681]:   <uuid>5dbdce7a-d331-435f-8dd3-d192b8ce7d5d</uuid>
Aug 16 06:38:16 user nova-compute[74681]:   <name>instance-00000033</name>
Aug 16 06:38:16 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:38:16 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:38:16 user nova-compute[74681]:   <metadata>
Aug 16 06:38:16 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:38:16 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:38:16 user nova-compute[74681]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-482528149</nova:name>
Aug 16 06:38:16 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:38:16</nova:creationTime>
Aug 16 06:38:16 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:38:16 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:38:16 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:38:16 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:38:16 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:38:16 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:38:16 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:38:16 user nova-compute[74681]:       <nova:owner>
Aug 16 06:38:16 user nova-compute[74681]:         <nova:user uuid="8531a2b8138744d98b13b3cbdcd0c62c">tempest-SnapshotDataIntegrityTests-1703853827-project-member</nova:user>
Aug 16 06:38:16 user nova-compute[74681]:         <nova:project uuid="7ddf2ada3a5e4457b79cab432befc5e9">tempest-SnapshotDataIntegrityTests-1703853827</nova:project>
Aug 16 06:38:16 user nova-compute[74681]:       </nova:owner>
Aug 16 06:38:16 user nova-compute[74681]:       <nova:root type="image" uuid="89d7f25c-29d1-41cf-9690-6814b446c3b9"/>
Aug 16 06:38:16 user nova-compute[74681]:       <nova:ports>
Aug 16 06:38:16 user nova-compute[74681]:         <nova:port uuid="4138d117-4f17-46a5-868b-bf6f2c031f68">
Aug 16 06:38:16 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 06:38:16 user nova-compute[74681]:         </nova:port>
Aug 16 06:38:16 user nova-compute[74681]:       </nova:ports>
Aug 16 06:38:16 user nova-compute[74681]:     </nova:instance>
Aug 16 06:38:16 user nova-compute[74681]:   </metadata>
Aug 16 06:38:16 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:38:16 user nova-compute[74681]:     <system>
Aug 16 06:38:16 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:38:16 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:38:16 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:38:16 user nova-compute[74681]:       <entry name="serial">5dbdce7a-d331-435f-8dd3-d192b8ce7d5d</entry>
Aug 16 06:38:16 user nova-compute[74681]:       <entry name="uuid">5dbdce7a-d331-435f-8dd3-d192b8ce7d5d</entry>
Aug 16 06:38:16 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:38:16 user nova-compute[74681]:     </system>
Aug 16 06:38:16 user nova-compute[74681]:   </sysinfo>
Aug 16 06:38:16 user nova-compute[74681]:   <os>
Aug 16 06:38:16 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:38:16 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:38:16 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:38:16 user nova-compute[74681]:   </os>
Aug 16 06:38:16 user nova-compute[74681]:   <features>
Aug 16 06:38:16 user nova-compute[74681]:     <acpi/>
Aug 16 06:38:16 user nova-compute[74681]:     <apic/>
Aug 16 06:38:16 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:38:16 user nova-compute[74681]:   </features>
Aug 16 06:38:16 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:38:16 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:38:16 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:38:16 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:38:16 user nova-compute[74681]:   </clock>
Aug 16 06:38:16 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:38:16 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:38:16 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:38:16 user nova-compute[74681]:   </cpu>
Aug 16 06:38:16 user nova-compute[74681]:   <devices>
Aug 16 06:38:16 user nova-compute[74681]:     <disk type="file" device="disk">
Aug 16 06:38:16 user nova-compute[74681]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 06:38:16 user nova-compute[74681]:       <source file="/opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk"/>
Aug 16 06:38:16 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:38:16 user nova-compute[74681]:     </disk>
Aug 16 06:38:16 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:38:16 user nova-compute[74681]:       <mac address="fa:16:3e:da:6e:a9"/>
Aug 16 06:38:16 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:38:16 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:38:16 user nova-compute[74681]:       <target dev="tap4138d117-4f"/>
Aug 16 06:38:16 user nova-compute[74681]:     </interface>
Aug 16 06:38:16 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:38:16 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/console.log" append="off"/>
Aug 16 06:38:16 user nova-compute[74681]:     </serial>
Aug 16 06:38:16 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:38:16 user nova-compute[74681]:     <video>
Aug 16 06:38:16 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:38:16 user nova-compute[74681]:     </video>
Aug 16 06:38:16 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:38:16 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:38:16 user nova-compute[74681]:     </rng>
Aug 16 06:38:16 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:38:16 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:38:16 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:38:16 user nova-compute[74681]:     </memballoon>
Aug 16 06:38:16 user nova-compute[74681]:   </devices>
Aug 16 06:38:16 user nova-compute[74681]: </domain>
Aug 16 06:38:16 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-482528149',display_name='tempest-SnapshotDataIntegrityTests-server-482528149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-482528149',id=51,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4519zWBhP/u0wLmhoUh7ctSS0WiRmRfFWqPHdk8pKQV8DvWTb2isn008J+YbXShTzFJ1+5LNzhYZ39N+ffSOlkoQnO+WB/ToS/OqtX41NehsnUjVf60PkvOFM6zkAa1Q==',key_name='tempest-keypair-699899462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ddf2ada3a5e4457b79cab432befc5e9',ramdisk_id='',reservation_id='r-ibxkk12x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1703853827',owner_user_name='tempest-SnapshotDataIntegrityTests-1703853827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:38:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8531a2b8138744d98b13b3cbdcd0c62c',uuid=5dbdce7a-d331-435f-8dd3-d192b8ce7d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Converting VIF {"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=4138d117-4f17-46a5-868b-bf6f2c031f68,network=Network(7740c34e-0b66-4d60-9956-f4c65cd48b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138d117-4f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG os_vif [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=4138d117-4f17-46a5-868b-bf6f2c031f68,network=Network(7740c34e-0b66-4d60-9956-f4c65cd48b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138d117-4f') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4138d117-4f, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4138d117-4f, col_values=(('external_ids', {'iface-id': '4138d117-4f17-46a5-868b-bf6f2c031f68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:6e:a9', 'vm-uuid': '5dbdce7a-d331-435f-8dd3-d192b8ce7d5d'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:16 user nova-compute[74681]: INFO os_vif [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=4138d117-4f17-46a5-868b-bf6f2c031f68,network=Network(7740c34e-0b66-4d60-9956-f4c65cd48b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138d117-4f')
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No VIF found with MAC fa:16:3e:da:6e:a9, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:38:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:17 user nova-compute[74681]: DEBUG nova.network.neutron [req-a6a73d7f-0e57-4fe4-9d3c-4fb4225a1fb2 req-30ae6000-85a6-4a80-a098-6eb28b10f37a service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updated VIF entry in instance network info cache for port 4138d117-4f17-46a5-868b-bf6f2c031f68. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:38:17 user nova-compute[74681]: DEBUG nova.network.neutron [req-a6a73d7f-0e57-4fe4-9d3c-4fb4225a1fb2 req-30ae6000-85a6-4a80-a098-6eb28b10f37a service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:38:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a6a73d7f-0e57-4fe4-9d3c-4fb4225a1fb2 req-30ae6000-85a6-4a80-a098-6eb28b10f37a service nova] Releasing lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-06ea7a9a-599b-4973-a713-64e517ef88a3 req-19aaf23c-2a0b-477c-bfbc-270fb4694ef1 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received event network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06ea7a9a-599b-4973-a713-64e517ef88a3 req-19aaf23c-2a0b-477c-bfbc-270fb4694ef1 service nova] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06ea7a9a-599b-4973-a713-64e517ef88a3 req-19aaf23c-2a0b-477c-bfbc-270fb4694ef1 service nova] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-06ea7a9a-599b-4973-a713-64e517ef88a3 req-19aaf23c-2a0b-477c-bfbc-270fb4694ef1 service nova] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG nova.compute.manager [req-06ea7a9a-599b-4973-a713-64e517ef88a3 req-19aaf23c-2a0b-477c-bfbc-270fb4694ef1 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] No waiting events found dispatching network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:18 user nova-compute[74681]: WARNING nova.compute.manager [req-06ea7a9a-599b-4973-a713-64e517ef88a3 req-19aaf23c-2a0b-477c-bfbc-270fb4694ef1 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received unexpected event network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 for instance with vm_state building and task_state spawning.
Aug 16 06:38:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167900.2694178, 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:38:20 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] VM Resumed (Lifecycle Event)
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:38:20 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Instance spawned successfully.
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:20 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167900.2706997, 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:38:20 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] VM Started (Lifecycle Event)
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:38:20 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:38:20 user nova-compute[74681]: INFO nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:38:20 user nova-compute[74681]: INFO nova.compute.manager [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Took 6.49 seconds to build instance.
Aug 16 06:38:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-79f56f3f-378b-4633-a555-ac92ef963961 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.638s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-33cf4037-f242-4e24-b7b2-658bb813a0d0 req-cf8fb1f3-3312-461f-85b1-c700b687681c service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received event network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-33cf4037-f242-4e24-b7b2-658bb813a0d0 req-cf8fb1f3-3312-461f-85b1-c700b687681c service nova] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-33cf4037-f242-4e24-b7b2-658bb813a0d0 req-cf8fb1f3-3312-461f-85b1-c700b687681c service nova] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-33cf4037-f242-4e24-b7b2-658bb813a0d0 req-cf8fb1f3-3312-461f-85b1-c700b687681c service nova] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:20 user nova-compute[74681]: DEBUG nova.compute.manager [req-33cf4037-f242-4e24-b7b2-658bb813a0d0 req-cf8fb1f3-3312-461f-85b1-c700b687681c service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] No waiting events found dispatching network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:20 user nova-compute[74681]: WARNING nova.compute.manager [req-33cf4037-f242-4e24-b7b2-658bb813a0d0 req-cf8fb1f3-3312-461f-85b1-c700b687681c service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received unexpected event network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 for instance with vm_state active and task_state None.
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:38:21 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Creating image(s)
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Ensure instance console log exists: /opt/stack/data/nova/instances/8dc180fb-754c-4b2a-b75b-6b9ec9b54bea/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Start _get_guest_xml network_info=[{"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'c503b6bf-c302-4a58-88b5-3932ea017806', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCiYgsWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8dc180fb-754c-4b2a-b75b-6b9ec9b54bea', 'attached_at': '', 'detached_at': '', 'volume_id': '77ce380e-c30a-4071-8ef0-7ff2e57f97f9', 'serial': '77ce380e-c30a-4071-8ef0-7ff2e57f97f9'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:38:21 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:38:21 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCiYgsWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:38:21 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:38:21 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:38:21 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1785417-70e6-4fd1-8321-fcb75b0c38b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:38:21 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[736c261d-98f6-4e59-9543-71a25a0cee2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9] added
Aug 16 06:38:21 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb783f-8908-42f6-b6c9-b7562cfc3673]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada52aa-53a3-4919-bb96-90bbe142cf53]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCiYgsWR {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KCiYgsWR" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c527ad-6c26-4e44-a42d-35b2a3d2177c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KCiYgsWR'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f4fe00-635c-493c-a590-8375f009257c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[65047ae4-bdcc-423c-896e-8c18047e67b0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a5df31-7f7e-4a5f-a902-b86a1bc7b9ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9, portal: 172.16.0.220,3260]
Aug 16 06:38:21 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9, portal: 172.16.0.220,3260] successful.
Aug 16 06:38:21 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f829af5-ec64-48ac-9cd7-b8000b1ba887]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[af83fb26-418e-4a6f-98bb-576dffe7e5a3]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)
Aug 16 06:38:21 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd6dc09-c99b-431b-affd-065361461ad4]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCiYgsWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23662343566363436', 'path': '/dev/sdd'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662343566363436', 'path': '/dev/sdd'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-553606598',display_name='tempest-TestVolumeBootPattern-server-553606598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-553606598',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-bqfs8t65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:38:11Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=8dc180fb-754c-4b2a-b75b-6b9ec9b54bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=e8740382-21b9-480f-bb54-749e6923d77e,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8740382-21') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.objects.instance [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:38:22 user nova-compute[74681]:   <uuid>8dc180fb-754c-4b2a-b75b-6b9ec9b54bea</uuid>
Aug 16 06:38:22 user nova-compute[74681]:   <name>instance-00000032</name>
Aug 16 06:38:22 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:38:22 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:38:22 user nova-compute[74681]:   <metadata>
Aug 16 06:38:22 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:38:22 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:38:22 user nova-compute[74681]:       <nova:name>tempest-TestVolumeBootPattern-server-553606598</nova:name>
Aug 16 06:38:22 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:38:21</nova:creationTime>
Aug 16 06:38:22 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:38:22 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:38:22 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:38:22 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:38:22 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:38:22 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:38:22 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:38:22 user nova-compute[74681]:       <nova:owner>
Aug 16 06:38:22 user nova-compute[74681]:         <nova:user uuid="efd0444b91944ba5b2d1e3c852456964">tempest-TestVolumeBootPattern-702107063-project-member</nova:user>
Aug 16 06:38:22 user nova-compute[74681]:         <nova:project uuid="3fbbdfedd72a4b38aaa5acd93ac18163">tempest-TestVolumeBootPattern-702107063</nova:project>
Aug 16 06:38:22 user nova-compute[74681]:       </nova:owner>
Aug 16 06:38:22 user nova-compute[74681]:       <nova:ports>
Aug 16 06:38:22 user nova-compute[74681]:         <nova:port uuid="e8740382-21b9-480f-bb54-749e6923d77e">
Aug 16 06:38:22 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 06:38:22 user nova-compute[74681]:         </nova:port>
Aug 16 06:38:22 user nova-compute[74681]:       </nova:ports>
Aug 16 06:38:22 user nova-compute[74681]:     </nova:instance>
Aug 16 06:38:22 user nova-compute[74681]:   </metadata>
Aug 16 06:38:22 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:38:22 user nova-compute[74681]:     <system>
Aug 16 06:38:22 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:38:22 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:38:22 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:38:22 user nova-compute[74681]:       <entry name="serial">8dc180fb-754c-4b2a-b75b-6b9ec9b54bea</entry>
Aug 16 06:38:22 user nova-compute[74681]:       <entry name="uuid">8dc180fb-754c-4b2a-b75b-6b9ec9b54bea</entry>
Aug 16 06:38:22 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:38:22 user nova-compute[74681]:     </system>
Aug 16 06:38:22 user nova-compute[74681]:   </sysinfo>
Aug 16 06:38:22 user nova-compute[74681]:   <os>
Aug 16 06:38:22 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:38:22 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:38:22 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:38:22 user nova-compute[74681]:   </os>
Aug 16 06:38:22 user nova-compute[74681]:   <features>
Aug 16 06:38:22 user nova-compute[74681]:     <acpi/>
Aug 16 06:38:22 user nova-compute[74681]:     <apic/>
Aug 16 06:38:22 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:38:22 user nova-compute[74681]:   </features>
Aug 16 06:38:22 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:38:22 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:38:22 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:38:22 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:38:22 user nova-compute[74681]:   </clock>
Aug 16 06:38:22 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:38:22 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:38:22 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:38:22 user nova-compute[74681]:   </cpu>
Aug 16 06:38:22 user nova-compute[74681]:   <devices>
Aug 16 06:38:22 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:38:22 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:38:22 user nova-compute[74681]:       <source dev="/dev/sdd"/>
Aug 16 06:38:22 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:38:22 user nova-compute[74681]:       <serial>77ce380e-c30a-4071-8ef0-7ff2e57f97f9</serial>
Aug 16 06:38:22 user nova-compute[74681]:     </disk>
Aug 16 06:38:22 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:38:22 user nova-compute[74681]:       <mac address="fa:16:3e:2c:b0:ca"/>
Aug 16 06:38:22 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:38:22 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:38:22 user nova-compute[74681]:       <target dev="tape8740382-21"/>
Aug 16 06:38:22 user nova-compute[74681]:     </interface>
Aug 16 06:38:22 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:38:22 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/8dc180fb-754c-4b2a-b75b-6b9ec9b54bea/console.log" append="off"/>
Aug 16 06:38:22 user nova-compute[74681]:     </serial>
Aug 16 06:38:22 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:38:22 user nova-compute[74681]:     <video>
Aug 16 06:38:22 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:38:22 user nova-compute[74681]:     </video>
Aug 16 06:38:22 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:38:22 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:38:22 user nova-compute[74681]:     </rng>
Aug 16 06:38:22 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:38:22 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:38:22 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:38:22 user nova-compute[74681]:     </memballoon>
Aug 16 06:38:22 user nova-compute[74681]:   </devices>
Aug 16 06:38:22 user nova-compute[74681]: </domain>
Aug 16 06:38:22 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-553606598',display_name='tempest-TestVolumeBootPattern-server-553606598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-553606598',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-bqfs8t65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:38:11Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=8dc180fb-754c-4b2a-b75b-6b9ec9b54bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=e8740382-21b9-480f-bb54-749e6923d77e,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8740382-21') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG os_vif [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=e8740382-21b9-480f-bb54-749e6923d77e,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8740382-21') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8740382-21, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8740382-21, col_values=(('external_ids', {'iface-id': 'e8740382-21b9-480f-bb54-749e6923d77e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:b0:ca', 'vm-uuid': '8dc180fb-754c-4b2a-b75b-6b9ec9b54bea'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:22 user nova-compute[74681]: INFO os_vif [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=e8740382-21b9-480f-bb54-749e6923d77e,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8740382-21')
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:38:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] No VIF found with MAC fa:16:3e:2c:b0:ca, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:38:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:24 user nova-compute[74681]: INFO nova.compute.manager [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Terminating instance
Aug 16 06:38:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-c71793a4-b277-40b6-b84f-180f985ebabe req-d7b01620-5774-43e0-ac18-b872ad426258 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c71793a4-b277-40b6-b84f-180f985ebabe req-d7b01620-5774-43e0-ac18-b872ad426258 service nova] Acquiring lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c71793a4-b277-40b6-b84f-180f985ebabe req-d7b01620-5774-43e0-ac18-b872ad426258 service nova] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c71793a4-b277-40b6-b84f-180f985ebabe req-d7b01620-5774-43e0-ac18-b872ad426258 service nova] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-c71793a4-b277-40b6-b84f-180f985ebabe req-d7b01620-5774-43e0-ac18-b872ad426258 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] No waiting events found dispatching network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:24 user nova-compute[74681]: WARNING nova.compute.manager [req-c71793a4-b277-40b6-b84f-180f985ebabe req-d7b01620-5774-43e0-ac18-b872ad426258 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received unexpected event network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e for instance with vm_state building and task_state spawning.
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-b44194da-0d4d-40eb-b9da-17f197ace4e4 req-ae51b0c5-b301-4daa-b34b-e94c7c70d070 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b44194da-0d4d-40eb-b9da-17f197ace4e4 req-ae51b0c5-b301-4daa-b34b-e94c7c70d070 service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b44194da-0d4d-40eb-b9da-17f197ace4e4 req-ae51b0c5-b301-4daa-b34b-e94c7c70d070 service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b44194da-0d4d-40eb-b9da-17f197ace4e4 req-ae51b0c5-b301-4daa-b34b-e94c7c70d070 service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-b44194da-0d4d-40eb-b9da-17f197ace4e4 req-ae51b0c5-b301-4daa-b34b-e94c7c70d070 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG nova.compute.manager [req-b44194da-0d4d-40eb-b9da-17f197ace4e4 req-ae51b0c5-b301-4daa-b34b-e94c7c70d070 service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:24 user nova-compute[74681]: INFO nova.compute.manager [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Terminating instance
Aug 16 06:38:24 user nova-compute[74681]: DEBUG nova.compute.manager [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:24 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Instance destroyed successfully.
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.objects.instance [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lazy-loading 'resources' on Instance uuid 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:38:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Instance destroyed successfully.
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.objects.instance [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'resources' on Instance uuid a6ac7136-989e-4e7e-9efe-15d47bff5be3 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-291200869',display_name='tempest-TestMinimumBasicScenario-server-291200869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-291200869',id=47,image_ref='bfa6bfcc-0172-4a00-9006-68bb2633ce65',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZGrSnhEeEQogILyhnl2N4m9kA04pT4sYbGeS9B+8tKYm/HaZ1bt+aZfdeBHBVckBm+L5KfBbk9A+Jjv15bxCpagjT2NryXW9KYtyViL4UVC/uSBFIrbFPNy+n8l1p+Dg==',key_name='tempest-TestMinimumBasicScenario-1229642197',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:33:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d51e79d8a3ec4a3b877a82b3863c5a10',ramdisk_id='',reservation_id='r-467oe12w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bfa6bfcc-0172-4a00-9006-68bb2633ce65',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1506407050',owner_user_name='tempest-TestMinimumBasicScenario-1506407050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:35:42Z,user_data=None,user_id='ffd09ff1adb847afae4d0dc786a661e7',uuid=8111c0c7-5bf6-493e-8e8b-b9bb091e82fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converting VIF {"id": "8e510d87-d382-4e3b-b684-aca0fed10cec", "address": "fa:16:3e:43:9e:14", "network": {"id": "d4cd8427-73bc-4150-bf0b-1337fec24d8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1118055101-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51e79d8a3ec4a3b877a82b3863c5a10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e510d87-d3", "ovs_interfaceid": "8e510d87-d382-4e3b-b684-aca0fed10cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:9e:14,bridge_name='br-int',has_traffic_filtering=True,id=8e510d87-d382-4e3b-b684-aca0fed10cec,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e510d87-d3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_vif [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:9e:14,bridge_name='br-int',has_traffic_filtering=True,id=8e510d87-d382-4e3b-b684-aca0fed10cec,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e510d87-d3') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-331157194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-331157194',id=45,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-yvpt7nfp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:36:38Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=a6ac7136-989e-4e7e-9efe-15d47bff5be3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "address": "fa:16:3e:27:85:90", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63d0691b-6e", "ovs_interfaceid": "63d0691b-6e37-40ae-9807-8f63bfa0bf6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:85:90,bridge_name='br-int',has_traffic_filtering=True,id=63d0691b-6e37-40ae-9807-8f63bfa0bf6d,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d0691b-6e') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_vif [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:85:90,bridge_name='br-int',has_traffic_filtering=True,id=63d0691b-6e37-40ae-9807-8f63bfa0bf6d,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d0691b-6e') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e510d87-d3, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63d0691b-6e, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:38:25 user nova-compute[74681]: INFO os_vif [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:9e:14,bridge_name='br-int',has_traffic_filtering=True,id=8e510d87-d382-4e3b-b684-aca0fed10cec,network=Network(d4cd8427-73bc-4150-bf0b-1337fec24d8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e510d87-d3')
Aug 16 06:38:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Deleting instance files /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc_del
Aug 16 06:38:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Deletion of /opt/stack/data/nova/instances/8111c0c7-5bf6-493e-8e8b-b9bb091e82fc_del complete
Aug 16 06:38:25 user nova-compute[74681]: INFO os_vif [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:85:90,bridge_name='br-int',has_traffic_filtering=True,id=63d0691b-6e37-40ae-9807-8f63bfa0bf6d,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63d0691b-6e')
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFBwkdLE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:38:25 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be4fce-85ad-4369-a2ee-8f4836e8b89f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b6bf60-0710-4719-a6ac-a0eccaf89cda]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:25 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:25 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:25 user nova-compute[74681]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)
Aug 16 06:38:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:38:25 user nova-compute[74681]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd (non-flash)
Aug 16 06:38:25 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:38:25 user nova-compute[74681]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)
Aug 16 06:38:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948475db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:38:25 user nova-compute[74681]: INFO nova.compute.manager [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[09843fbd-1690-4998-bc70-854c62671d8c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51792d-25b5-413e-bbbc-5194720e5a3d]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[03de03e7-5232-4eca-83c3-242fbb64944f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a94240-0c8c-47b4-b553-e6b19fed638a]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b265e4-11e0-41ba-9b69-7ee319630610]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d4b58-c33a-41ce-ad36-e7b5675ef37f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd, portal: 172.16.0.220,3260]
Aug 16 06:38:25 user nova-compute[74681]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd, portal: 172.16.0.220,3260] successful.
Aug 16 06:38:25 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5c33e85-3f84-4e81-b9a9-ace8e01a2ecd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0d8f9-8dbf-4e43-b036-d6bc5b5d5d1f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] <== disconnect_volume: return (380ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:38:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Deleting instance files /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3_del
Aug 16 06:38:25 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Deletion of /opt/stack/data/nova/instances/a6ac7136-989e-4e7e-9efe-15d47bff5be3_del complete
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: INFO nova.compute.manager [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 16 06:38:25 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:25 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Took 0.81 seconds to deallocate network for instance.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-0057f9dd-6968-4de3-a0c3-a966ed405776 req-fb81c346-a71a-4e8d-9105-a55a07b1d28c service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-deleted-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Acquiring lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] No waiting events found dispatching network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:26 user nova-compute[74681]: WARNING nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received unexpected event network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e for instance with vm_state building and task_state spawning.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-unplugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Acquiring lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] No waiting events found dispatching network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:26 user nova-compute[74681]: WARNING nova.compute.manager [req-a8c3c944-00d9-4309-81c5-ac4e75e1c046 req-91c6b344-4d2d-49c7-b846-b500081cdd0e service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received unexpected event network-vif-plugged-63d0691b-6e37-40ae-9807-8f63bfa0bf6d for instance with vm_state active and task_state deleting.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167906.36685, 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] VM Resumed (Lifecycle Event)
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Instance spawned successfully.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:26 user nova-compute[74681]: WARNING nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state deleted and task_state None.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:26 user nova-compute[74681]: WARNING nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state deleted and task_state None.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:26 user nova-compute[74681]: WARNING nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state deleted and task_state None.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:26 user nova-compute[74681]: WARNING nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-unplugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state deleted and task_state None.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Acquiring lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] No waiting events found dispatching network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:38:26 user nova-compute[74681]: WARNING nova.compute.manager [req-eeef8371-0558-46be-ae17-63be4f47005a req-0c6a0dfe-28d3-43d9-b8d0-501c2885d94f service nova] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Received unexpected event network-vif-plugged-8e510d87-d382-4e3b-b684-aca0fed10cec for instance with vm_state deleted and task_state None.
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692167906.368857, 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] VM Started (Lifecycle Event)
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Took 0.69 seconds to deallocate network for instance.
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.compute.manager [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Took 16.37 seconds to build instance.
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-d882c527-e768-45e1-980e-453f2ac247c6 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.475s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Deleted allocations for instance 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc
Aug 16 06:38:26 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-1a7e5ec8-50eb-4bd4-8bd5-90041980e116 tempest-TestMinimumBasicScenario-1506407050 tempest-TestMinimumBasicScenario-1506407050-project-member] Lock "8111c0c7-5bf6-493e-8e8b-b9bb091e82fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.822s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:27 user nova-compute[74681]: INFO nova.compute.manager [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Took 0.85 seconds to detach 1 volumes for instance.
Aug 16 06:38:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:27 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:38:27 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:38:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:27 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Deleted allocations for instance a6ac7136-989e-4e7e-9efe-15d47bff5be3
Aug 16 06:38:27 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-8a778f75-c01a-46a0-972a-cf0a3ba1a565 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "a6ac7136-989e-4e7e-9efe-15d47bff5be3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.430s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-83cc5701-fd1c-4d1b-a388-4e09a063cf0b req-0cb0837d-9416-47fe-9f35-2e1cb411277d service nova] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Received event network-vif-deleted-63d0691b-6e37-40ae-9807-8f63bfa0bf6d {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:38:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:40 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167905.236545, 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:38:40 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] VM Stopped (Lifecycle Event)
Aug 16 06:38:40 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167905.2443638, a6ac7136-989e-4e7e-9efe-15d47bff5be3 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:38:40 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] VM Stopped (Lifecycle Event)
Aug 16 06:38:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2a073a48-7766-4c9e-af19-88078aac2758 None None] [instance: 8111c0c7-5bf6-493e-8e8b-b9bb091e82fc] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:38:40 user nova-compute[74681]: DEBUG nova.compute.manager [None req-ac121708-a428-4e74-b36e-c0be2b30f338 None None] [instance: a6ac7136-989e-4e7e-9efe-15d47bff5be3] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:38:40 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:52 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:38:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:38:57 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:38:57 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=7855MB free_disk=24.927852630615234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b5738c6f-58a1-4659-8331-1141c0fea1cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:38:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:38:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:01 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:01 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:39:02 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Didn't find any instances for network info cache update. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 06:39:05 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:39:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:07 user nova-compute[74681]: INFO nova.compute.manager [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Terminating instance
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-798fee27-0f5c-4efe-9a6a-42c32d3622d9 req-88bb7c50-869b-4787-bdcd-a1db4300ada3 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received event network-vif-unplugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-798fee27-0f5c-4efe-9a6a-42c32d3622d9 req-88bb7c50-869b-4787-bdcd-a1db4300ada3 service nova] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-798fee27-0f5c-4efe-9a6a-42c32d3622d9 req-88bb7c50-869b-4787-bdcd-a1db4300ada3 service nova] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-798fee27-0f5c-4efe-9a6a-42c32d3622d9 req-88bb7c50-869b-4787-bdcd-a1db4300ada3 service nova] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-798fee27-0f5c-4efe-9a6a-42c32d3622d9 req-88bb7c50-869b-4787-bdcd-a1db4300ada3 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] No waiting events found dispatching network-vif-unplugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-798fee27-0f5c-4efe-9a6a-42c32d3622d9 req-88bb7c50-869b-4787-bdcd-a1db4300ada3 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received event network-vif-unplugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:39:07 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Instance destroyed successfully.
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lazy-loading 'resources' on Instance uuid b5738c6f-58a1-4659-8331-1141c0fea1cf {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:35:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1851544835',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1851544835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1851544',id=48,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGusim1gPlJ6m/HxHUcDJm8r4V9RKhJol8NwYWA6+10Ku4b968xeCGtLvimgnBrQpaQWBaUxCwKV+pGlaDnGbA5IKIYi4mMC6tgTve/qEbsfUM8MKmdfhrxXCPLC/PxEZg==',key_name='tempest-keypair-1382469024',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:36:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9f67a11fca845049b48179f437addac',ramdisk_id='',reservation_id='r-1993lihd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-456051724',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='edc23f0062344c7a84bd576e41ef67f9',uuid=b5738c6f-58a1-4659-8331-1141c0fea1cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Converting VIF {"id": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "address": "fa:16:3e:5a:29:12", "network": {"id": "41b2150f-a735-47ad-b888-68dcb267cdcc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149922130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f67a11fca845049b48179f437addac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1f8c1d9-3d", "ovs_interfaceid": "b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:29:12,bridge_name='br-int',has_traffic_filtering=True,id=b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a,network=Network(41b2150f-a735-47ad-b888-68dcb267cdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f8c1d9-3d') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG os_vif [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:29:12,bridge_name='br-int',has_traffic_filtering=True,id=b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a,network=Network(41b2150f-a735-47ad-b888-68dcb267cdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f8c1d9-3d') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1f8c1d9-3d, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:07 user nova-compute[74681]: INFO os_vif [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:29:12,bridge_name='br-int',has_traffic_filtering=True,id=b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a,network=Network(41b2150f-a735-47ad-b888-68dcb267cdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1f8c1d9-3d')
Aug 16 06:39:07 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Deleting instance files /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf_del
Aug 16 06:39:07 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Deletion of /opt/stack/data/nova/instances/b5738c6f-58a1-4659-8331-1141c0fea1cf_del complete
Aug 16 06:39:07 user nova-compute[74681]: INFO nova.compute.manager [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 16 06:39:07 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:39:07 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-76e16092-8f56-4849-82b2-7af215184299 req-dfe39928-cbc2-457d-83dc-829164aac514 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received event network-vif-deleted-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:39:09 user nova-compute[74681]: INFO nova.compute.manager [req-76e16092-8f56-4849-82b2-7af215184299 req-dfe39928-cbc2-457d-83dc-829164aac514 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Neutron deleted interface b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a; detaching it from the instance and deleting it from the info cache
Aug 16 06:39:09 user nova-compute[74681]: DEBUG nova.network.neutron [req-76e16092-8f56-4849-82b2-7af215184299 req-dfe39928-cbc2-457d-83dc-829164aac514 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:39:09 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Took 1.13 seconds to deallocate network for instance.
Aug 16 06:39:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-76e16092-8f56-4849-82b2-7af215184299 req-dfe39928-cbc2-457d-83dc-829164aac514 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Detach interface failed, port_id=b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a, reason: Instance b5738c6f-58a1-4659-8331-1141c0fea1cf could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-85c2ac37-d0a6-4e6b-a10d-1f65931fee8d req-a2624ec5-ff8b-4118-be47-43e9ec1317e1 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received event network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-85c2ac37-d0a6-4e6b-a10d-1f65931fee8d req-a2624ec5-ff8b-4118-be47-43e9ec1317e1 service nova] Acquiring lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-85c2ac37-d0a6-4e6b-a10d-1f65931fee8d req-a2624ec5-ff8b-4118-be47-43e9ec1317e1 service nova] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-85c2ac37-d0a6-4e6b-a10d-1f65931fee8d req-a2624ec5-ff8b-4118-be47-43e9ec1317e1 service nova] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-85c2ac37-d0a6-4e6b-a10d-1f65931fee8d req-a2624ec5-ff8b-4118-be47-43e9ec1317e1 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] No waiting events found dispatching network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:39:09 user nova-compute[74681]: WARNING nova.compute.manager [req-85c2ac37-d0a6-4e6b-a10d-1f65931fee8d req-a2624ec5-ff8b-4118-be47-43e9ec1317e1 service nova] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Received unexpected event network-vif-plugged-b1f8c1d9-3de0-4f6f-9fa3-dc45396fe12a for instance with vm_state deleted and task_state None.
Aug 16 06:39:09 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:39:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:09 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Deleted allocations for instance b5738c6f-58a1-4659-8331-1141c0fea1cf
Aug 16 06:39:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2f15aa21-4b5a-4620-a541-f01ad42229a9 tempest-TestServerVolumeAttachScenarioOldVersion-456051724 tempest-TestServerVolumeAttachScenarioOldVersion-456051724-project-member] Lock "b5738c6f-58a1-4659-8331-1141c0fea1cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.518s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:15 user nova-compute[74681]: INFO nova.compute.manager [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Terminating instance
Aug 16 06:39:15 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-c9cf4f64-f77d-40e5-87c4-d0357f300b0f req-4daf894b-c0d4-4bb8-9c9d-e387fb3a64e1 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received event network-vif-unplugged-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c9cf4f64-f77d-40e5-87c4-d0357f300b0f req-4daf894b-c0d4-4bb8-9c9d-e387fb3a64e1 service nova] Acquiring lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c9cf4f64-f77d-40e5-87c4-d0357f300b0f req-4daf894b-c0d4-4bb8-9c9d-e387fb3a64e1 service nova] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c9cf4f64-f77d-40e5-87c4-d0357f300b0f req-4daf894b-c0d4-4bb8-9c9d-e387fb3a64e1 service nova] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-c9cf4f64-f77d-40e5-87c4-d0357f300b0f req-4daf894b-c0d4-4bb8-9c9d-e387fb3a64e1 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] No waiting events found dispatching network-vif-unplugged-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG nova.compute.manager [req-c9cf4f64-f77d-40e5-87c4-d0357f300b0f req-4daf894b-c0d4-4bb8-9c9d-e387fb3a64e1 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received event network-vif-unplugged-86b625c3-b20c-4749-b442-9a91d85c2ade for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:39:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Instance destroyed successfully.
Aug 16 06:39:15 user nova-compute[74681]: DEBUG nova.objects.instance [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'resources' on Instance uuid 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:29:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1482480214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1482480214',id=41,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:29:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-s8rqu929',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:31:00Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=0ab4ec2f-f645-48dc-aada-fb2ce145bd6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "86b625c3-b20c-4749-b442-9a91d85c2ade", "address": "fa:16:3e:d5:03:4e", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86b625c3-b2", "ovs_interfaceid": "86b625c3-b20c-4749-b442-9a91d85c2ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=86b625c3-b20c-4749-b442-9a91d85c2ade,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b625c3-b2') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG os_vif [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=86b625c3-b20c-4749-b442-9a91d85c2ade,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b625c3-b2') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:15 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86b625c3-b2, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:39:16 user nova-compute[74681]: INFO os_vif [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:03:4e,bridge_name='br-int',has_traffic_filtering=True,id=86b625c3-b20c-4749-b442-9a91d85c2ade,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86b625c3-b2')
Aug 16 06:39:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Deleting instance files /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f_del
Aug 16 06:39:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Deletion of /opt/stack/data/nova/instances/0ab4ec2f-f645-48dc-aada-fb2ce145bd6f_del complete
Aug 16 06:39:16 user nova-compute[74681]: INFO nova.compute.manager [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 16 06:39:16 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:39:16 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Took 0.50 seconds to deallocate network for instance.
Aug 16 06:39:16 user nova-compute[74681]: DEBUG nova.compute.manager [req-970d4882-00c5-493f-b475-995f5931e480 req-25b3d73e-e09c-4195-b0e7-0ea78494de29 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received event network-vif-deleted-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:39:16 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:16 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Deleted allocations for instance 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f
Aug 16 06:39:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-9a4a7e41-d275-4681-a0eb-9b723bb9f546 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-a00711bb-4e8f-4f18-8475-4e5cdf6b7add req-1656d843-61b7-4ae2-af18-82b5b959ab07 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received event network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:39:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00711bb-4e8f-4f18-8475-4e5cdf6b7add req-1656d843-61b7-4ae2-af18-82b5b959ab07 service nova] Acquiring lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00711bb-4e8f-4f18-8475-4e5cdf6b7add req-1656d843-61b7-4ae2-af18-82b5b959ab07 service nova] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a00711bb-4e8f-4f18-8475-4e5cdf6b7add req-1656d843-61b7-4ae2-af18-82b5b959ab07 service nova] Lock "0ab4ec2f-f645-48dc-aada-fb2ce145bd6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:17 user nova-compute[74681]: DEBUG nova.compute.manager [req-a00711bb-4e8f-4f18-8475-4e5cdf6b7add req-1656d843-61b7-4ae2-af18-82b5b959ab07 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] No waiting events found dispatching network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:39:17 user nova-compute[74681]: WARNING nova.compute.manager [req-a00711bb-4e8f-4f18-8475-4e5cdf6b7add req-1656d843-61b7-4ae2-af18-82b5b959ab07 service nova] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Received unexpected event network-vif-plugged-86b625c3-b20c-4749-b442-9a91d85c2ade for instance with vm_state deleted and task_state None.
Aug 16 06:39:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:22 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167947.8325653, b5738c6f-58a1-4659-8331-1141c0fea1cf => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:39:22 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] VM Stopped (Lifecycle Event)
Aug 16 06:39:22 user nova-compute[74681]: DEBUG nova.compute.manager [None req-66b3525f-410d-487f-9f68-fdbdf073c7e5 None None] [instance: b5738c6f-58a1-4659-8331-1141c0fea1cf] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:39:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:30 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692167955.9686227, 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:39:30 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] VM Stopped (Lifecycle Event)
Aug 16 06:39:30 user nova-compute[74681]: DEBUG nova.compute.manager [None req-d070223c-844c-471d-8d89-d016cb30df65 None None] [instance: 0ab4ec2f-f645-48dc-aada-fb2ce145bd6f] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:39:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:39:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:39:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:39:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:39:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:39:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:39:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:39:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8229MB free_disk=25.119056701660156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance b581cf93-c19c-4d1f-a000-113a548ee755 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:39:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:00 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:01 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:01 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:01 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-0ef637b4-7c8b-4848-a256-89a89fb7ed0d req-2771a81d-b7b0-454a-b9f1-c26fc0fb636c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-changed-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG nova.compute.manager [req-0ef637b4-7c8b-4848-a256-89a89fb7ed0d req-2771a81d-b7b0-454a-b9f1-c26fc0fb636c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Refreshing instance network info cache due to event network-changed-e8740382-21b9-480f-bb54-749e6923d77e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0ef637b4-7c8b-4848-a256-89a89fb7ed0d req-2771a81d-b7b0-454a-b9f1-c26fc0fb636c service nova] Acquiring lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0ef637b4-7c8b-4848-a256-89a89fb7ed0d req-2771a81d-b7b0-454a-b9f1-c26fc0fb636c service nova] Acquired lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG nova.network.neutron [req-0ef637b4-7c8b-4848-a256-89a89fb7ed0d req-2771a81d-b7b0-454a-b9f1-c26fc0fb636c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Refreshing network info cache for port e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG nova.network.neutron [req-0ef637b4-7c8b-4848-a256-89a89fb7ed0d req-2771a81d-b7b0-454a-b9f1-c26fc0fb636c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updated VIF entry in instance network info cache for port e8740382-21b9-480f-bb54-749e6923d77e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG nova.network.neutron [req-0ef637b4-7c8b-4848-a256-89a89fb7ed0d req-2771a81d-b7b0-454a-b9f1-c26fc0fb636c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updating instance_info_cache with network_info: [{"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-0ef637b4-7c8b-4848-a256-89a89fb7ed0d req-2771a81d-b7b0-454a-b9f1-c26fc0fb636c service nova] Releasing lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:03 user nova-compute[74681]: INFO nova.compute.manager [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Terminating instance
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-ec8bc08c-50c3-4b86-b08c-40fd5f84bc16 req-fbdd2688-a4f8-466d-9091-67f8968bdba4 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-vif-unplugged-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ec8bc08c-50c3-4b86-b08c-40fd5f84bc16 req-fbdd2688-a4f8-466d-9091-67f8968bdba4 service nova] Acquiring lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ec8bc08c-50c3-4b86-b08c-40fd5f84bc16 req-fbdd2688-a4f8-466d-9091-67f8968bdba4 service nova] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ec8bc08c-50c3-4b86-b08c-40fd5f84bc16 req-fbdd2688-a4f8-466d-9091-67f8968bdba4 service nova] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-ec8bc08c-50c3-4b86-b08c-40fd5f84bc16 req-fbdd2688-a4f8-466d-9091-67f8968bdba4 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] No waiting events found dispatching network-vif-unplugged-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.compute.manager [req-ec8bc08c-50c3-4b86-b08c-40fd5f84bc16 req-fbdd2688-a4f8-466d-9091-67f8968bdba4 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-vif-unplugged-e8740382-21b9-480f-bb54-749e6923d77e for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:03 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Instance destroyed successfully.
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.objects.instance [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'resources' on Instance uuid 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-553606598',display_name='tempest-TestVolumeBootPattern-server-553606598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-553606598',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-bqfs8t65',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:38:27Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=8dc180fb-754c-4b2a-b75b-6b9ec9b54bea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=e8740382-21b9-480f-bb54-749e6923d77e,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8740382-21') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_vif [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=e8740382-21b9-480f-bb54-749e6923d77e,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8740382-21') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8740382-21, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:03 user nova-compute[74681]: INFO os_vif [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:b0:ca,bridge_name='br-int',has_traffic_filtering=True,id=e8740382-21b9-480f-bb54-749e6923d77e,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8740382-21')
Aug 16 06:40:03 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KCiYgsWR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:40:03 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ad0920-4685-47f1-8eb3-1c19e38c71c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e72131e-91d6-4c47-9cb3-b3feae9b8d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb7f34-40f5-4257-8143-b669943d26f8]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e72131e-91d6-4c47-9cb3-b3feae9b8d17 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:40:03 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:03 user nova-compute[74681]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)
Aug 16 06:40:03 user nova-compute[74681]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e72131e-91d6-4c47-9cb3-b3feae9b8d17 (non-flash)
Aug 16 06:40:03 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:40:03 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:03 user nova-compute[74681]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 (non-flash)
Aug 16 06:40:03 user nova-compute[74681]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e72131e-91d6-4c47-9cb3-b3feae9b8d17 (non-flash)
Aug 16 06:40:03 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9484185fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9'): ({'sdd'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Removing single pathed devices sdd {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:40:03 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aea6e4-faf1-4c8b-87ec-de022c1c6a46]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca55a5-73e0-4f92-b6cb-f81d69dc4fad]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flushing IO for device /dev/sdd {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[da29dfe5-15ca-4dea-8aea-0511e06735ad]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.compute.manager [req-5dc80fa6-42b0-4e62-9b21-6512eae5305d req-17c8cdc1-7a05-4c4e-829c-04456189a80c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-changed-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.compute.manager [req-5dc80fa6-42b0-4e62-9b21-6512eae5305d req-17c8cdc1-7a05-4c4e-829c-04456189a80c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Refreshing instance network info cache due to event network-changed-e8740382-21b9-480f-bb54-749e6923d77e. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5dc80fa6-42b0-4e62-9b21-6512eae5305d req-17c8cdc1-7a05-4c4e-829c-04456189a80c service nova] Acquiring lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5dc80fa6-42b0-4e62-9b21-6512eae5305d req-17c8cdc1-7a05-4c4e-829c-04456189a80c service nova] Acquired lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.network.neutron [req-5dc80fa6-42b0-4e62-9b21-6512eae5305d req-17c8cdc1-7a05-4c4e-829c-04456189a80c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Refreshing network info cache for port e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Skipping network cache update for instance because it is being deleted. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[246ef4dd-3690-425d-a52b-eb09d2e97f60]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] SCSI volumes sdd have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[877aa7be-0a21-4db4-bd32-112ede244aba]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[351946e8-c826-4744-8ca4-4850408c564a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9, portal: 172.16.0.220,3260]
Aug 16 06:40:04 user nova-compute[74681]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9, portal: 172.16.0.220,3260] successful.
Aug 16 06:40:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77ce380e-c30a-4071-8ef0-7ff2e57f97f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e161e5c8-b0a3-4db2-950f-ee7b3587d6ad]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== disconnect_volume: return (338ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:40:04 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Deleting instance files /opt/stack/data/nova/instances/8dc180fb-754c-4b2a-b75b-6b9ec9b54bea_del
Aug 16 06:40:04 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Deletion of /opt/stack/data/nova/instances/8dc180fb-754c-4b2a-b75b-6b9ec9b54bea_del complete
Aug 16 06:40:04 user nova-compute[74681]: INFO nova.compute.manager [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:40:04 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 31137824-5fa9-44e3-86ca-5d0587c28454 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:05 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Took 0.71 seconds to deallocate network for instance.
Aug 16 06:40:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] Acquiring lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] No waiting events found dispatching network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:40:05 user nova-compute[74681]: WARNING nova.compute.manager [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received unexpected event network-vif-plugged-e8740382-21b9-480f-bb54-749e6923d77e for instance with vm_state active and task_state deleting.
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received event network-changed-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.compute.manager [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Refreshing instance network info cache due to event network-changed-4138d117-4f17-46a5-868b-bf6f2c031f68. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] Acquiring lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] Acquired lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.network.neutron [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Refreshing network info cache for port 4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.network.neutron [req-5dc80fa6-42b0-4e62-9b21-6512eae5305d req-17c8cdc1-7a05-4c4e-829c-04456189a80c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updated VIF entry in instance network info cache for port e8740382-21b9-480f-bb54-749e6923d77e. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.network.neutron [req-5dc80fa6-42b0-4e62-9b21-6512eae5305d req-17c8cdc1-7a05-4c4e-829c-04456189a80c service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Updating instance_info_cache with network_info: [{"id": "e8740382-21b9-480f-bb54-749e6923d77e", "address": "fa:16:3e:2c:b0:ca", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8740382-21", "ovs_interfaceid": "e8740382-21b9-480f-bb54-749e6923d77e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-5dc80fa6-42b0-4e62-9b21-6512eae5305d req-17c8cdc1-7a05-4c4e-829c-04456189a80c service nova] Releasing lock "refresh_cache-8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updating instance_info_cache with network_info: [{"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-31137824-5fa9-44e3-86ca-5d0587c28454" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "b581cf93-c19c-4d1f-a000-113a548ee755" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:05 user nova-compute[74681]: INFO nova.compute.manager [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Terminating instance
Aug 16 06:40:05 user nova-compute[74681]: DEBUG nova.compute.manager [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:40:05 user nova-compute[74681]: INFO nova.compute.manager [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Took 0.82 seconds to detach 1 volumes for instance.
Aug 16 06:40:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:05 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:06 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Deleted allocations for instance 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-92bff34b-5488-4cbf-a9e9-04f34c00e645 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "8dc180fb-754c-4b2a-b75b-6b9ec9b54bea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.256s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Instance destroyed successfully.
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.objects.instance [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'resources' on Instance uuid b581cf93-c19c-4d1f-a000-113a548ee755 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-295494951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-295494951',id=34,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-ai5gn9g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:27:17Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=b581cf93-c19c-4d1f-a000-113a548ee755,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "2bf6831f-c3c5-419a-901e-c0e465210cec", "address": "fa:16:3e:50:47:44", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf6831f-c3", "ovs_interfaceid": "2bf6831f-c3c5-419a-901e-c0e465210cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:47:44,bridge_name='br-int',has_traffic_filtering=True,id=2bf6831f-c3c5-419a-901e-c0e465210cec,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf6831f-c3') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_vif [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:47:44,bridge_name='br-int',has_traffic_filtering=True,id=2bf6831f-c3c5-419a-901e-c0e465210cec,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf6831f-c3') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bf6831f-c3, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:06 user nova-compute[74681]: INFO os_vif [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:47:44,bridge_name='br-int',has_traffic_filtering=True,id=2bf6831f-c3c5-419a-901e-c0e465210cec,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf6831f-c3')
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updated VIF entry in instance network info cache for port 4138d117-4f17-46a5-868b-bf6f2c031f68. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUvKztgD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:40:06 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.compute.manager [req-38467582-8226-4828-b191-7f9ed7d6f53c req-a883e5f8-59f9-430e-bf73-b6f1f8e78d07 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Received event network-vif-deleted-e8740382-21b9-480f-bb54-749e6923d77e {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:06 user nova-compute[74681]: INFO nova.compute.manager [req-38467582-8226-4828-b191-7f9ed7d6f53c req-a883e5f8-59f9-430e-bf73-b6f1f8e78d07 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Neutron deleted interface e8740382-21b9-480f-bb54-749e6923d77e; detaching it from the instance and deleting it from the info cache
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.network.neutron [req-38467582-8226-4828-b191-7f9ed7d6f53c req-a883e5f8-59f9-430e-bf73-b6f1f8e78d07 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Instance is deleted, no further info cache update {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.compute.manager [req-38467582-8226-4828-b191-7f9ed7d6f53c req-a883e5f8-59f9-430e-bf73-b6f1f8e78d07 service nova] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Detach interface failed, port_id=e8740382-21b9-480f-bb54-749e6923d77e, reason: Instance 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59491558-93f4-4512-807e-8ad5dbb37141 req-3297917f-552e-40ea-87b7-ff33bdb07de1 service nova] Releasing lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[42996624-6fcd-4b02-9ce5-1be73061db8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df3d007-4559-4d68-9bcd-c8e14dd3a470\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e72131e-91d6-4c47-9cb3-b3feae9b8d17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.compute.manager [req-041d6189-78e1-4a75-aa32-eb002d224997 req-cfb0ad8c-246c-4f92-b2a9-5ccbdbf5b99e service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-041d6189-78e1-4a75-aa32-eb002d224997 req-cfb0ad8c-246c-4f92-b2a9-5ccbdbf5b99e service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-041d6189-78e1-4a75-aa32-eb002d224997 req-cfb0ad8c-246c-4f92-b2a9-5ccbdbf5b99e service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-041d6189-78e1-4a75-aa32-eb002d224997 req-cfb0ad8c-246c-4f92-b2a9-5ccbdbf5b99e service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.compute.manager [req-041d6189-78e1-4a75-aa32-eb002d224997 req-cfb0ad8c-246c-4f92-b2a9-5ccbdbf5b99e service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.compute.manager [req-041d6189-78e1-4a75-aa32-eb002d224997 req-cfb0ad8c-246c-4f92-b2a9-5ccbdbf5b99e service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-unplugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bc333e-0564-4fdc-b03a-adee07db37e1]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e72131e-91d6-4c47-9cb3-b3feae9b8d17 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df3d007-4559-4d68-9bcd-c8e14dd3a470 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:40:06 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:06 user nova-compute[74681]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e72131e-91d6-4c47-9cb3-b3feae9b8d17 (non-flash)
Aug 16 06:40:06 user nova-compute[74681]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df3d007-4559-4d68-9bcd-c8e14dd3a470 (non-flash)
Aug 16 06:40:06 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 (non-flash)
Aug 16 06:40:06 user nova-compute[74681]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:06 user nova-compute[74681]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e72131e-91d6-4c47-9cb3-b3feae9b8d17 (non-flash)
Aug 16 06:40:06 user nova-compute[74681]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df3d007-4559-4d68-9bcd-c8e14dd3a470 (non-flash)
Aug 16 06:40:06 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94842e36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65dfb7b-1758-47e2-a30d-f4562ba7790e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da7a35-ea95-49b7-ba4b-a4cad3119606]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b7c10-4d36-4400-83ba-5e68f89b9db2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[47496cb9-706d-4921-b5ed-2db86229907a]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6d10f6-6dc7-441d-8f5d-b7064ad4592a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b2d30d-138e-47f7-818e-1dd12e3e6e55]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9, portal: 172.16.0.220,3260]
Aug 16 06:40:06 user nova-compute[74681]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9, portal: 172.16.0.220,3260] successful.
Aug 16 06:40:06 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f99e586e-a625-4637-bcb1-8657ad9962f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca30a63-15e1-483a-b803-7a2b1e9d6636]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] <== disconnect_volume: return (339ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:40:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Deleting instance files /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755_del
Aug 16 06:40:06 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Deletion of /opt/stack/data/nova/instances/b581cf93-c19c-4d1f-a000-113a548ee755_del complete
Aug 16 06:40:06 user nova-compute[74681]: INFO nova.compute.manager [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 16 06:40:06 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:40:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:07 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:07 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Took 0.64 seconds to deallocate network for instance.
Aug 16 06:40:08 user nova-compute[74681]: INFO nova.compute.manager [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Took 0.90 seconds to detach 1 volumes for instance.
Aug 16 06:40:08 user nova-compute[74681]: DEBUG nova.compute.manager [req-89722479-f41b-406b-b278-cd3b14606171 req-db43db03-a1d8-44a9-bf47-257d717e3cfa service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-deleted-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG nova.compute.manager [req-c5f83531-9288-486e-a65f-98c9b099884f req-95ccf824-a28c-4595-b1a9-49fac228653a service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c5f83531-9288-486e-a65f-98c9b099884f req-95ccf824-a28c-4595-b1a9-49fac228653a service nova] Acquiring lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c5f83531-9288-486e-a65f-98c9b099884f req-95ccf824-a28c-4595-b1a9-49fac228653a service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-c5f83531-9288-486e-a65f-98c9b099884f req-95ccf824-a28c-4595-b1a9-49fac228653a service nova] Lock "b581cf93-c19c-4d1f-a000-113a548ee755-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG nova.compute.manager [req-c5f83531-9288-486e-a65f-98c9b099884f req-95ccf824-a28c-4595-b1a9-49fac228653a service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] No waiting events found dispatching network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:40:08 user nova-compute[74681]: WARNING nova.compute.manager [req-c5f83531-9288-486e-a65f-98c9b099884f req-95ccf824-a28c-4595-b1a9-49fac228653a service nova] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Received unexpected event network-vif-plugged-2bf6831f-c3c5-419a-901e-c0e465210cec for instance with vm_state deleted and task_state None.
Aug 16 06:40:08 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:40:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:08 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Deleted allocations for instance b581cf93-c19c-4d1f-a000-113a548ee755
Aug 16 06:40:08 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-4765731e-ae68-4c64-b65f-721433755191 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "b581cf93-c19c-4d1f-a000-113a548ee755" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.968s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:09 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:12 user nova-compute[74681]: INFO nova.compute.manager [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attaching volume 87e03352-c218-4fdc-9963-04b8390a25aa to /dev/vdb
Aug 16 06:40:12 user nova-compute[74681]: DEBUG os_brick.utils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8890bb8-4173-4bc8-b559-c6a160d8641b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[213d91a4-66b8-4e3c-bd50-7802f01b5861]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[297f687b-b7d5-4cf6-a795-423ee978896d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4c6186-a4c8-4d90-954a-f80bd172e422]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:40:12 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:40:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[20adb98c-51c2-478b-8f21-6548ef21231d]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG os_brick.utils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:40:12 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating existing volume attachment record: 63e33521-7d08-41b1-adc2-4b9c767ec0e0 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:40:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:18 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692168003.852112, 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:40:18 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] VM Stopped (Lifecycle Event)
Aug 16 06:40:18 user nova-compute[74681]: DEBUG nova.compute.manager [None req-dd9a8ace-cef0-4ce9-a5cd-ebc962ef5da1 None None] [instance: 8dc180fb-754c-4b2a-b75b-6b9ec9b54bea] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:40:20 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:21 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692168006.383215, b581cf93-c19c-4d1f-a000-113a548ee755 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:40:21 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] VM Stopped (Lifecycle Event)
Aug 16 06:40:21 user nova-compute[74681]: DEBUG nova.compute.manager [None req-c4065e56-8c50-4167-89ac-b8bf3931bffc None None] [instance: b581cf93-c19c-4d1f-a000-113a548ee755] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:40:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnTDYazK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:40:22 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:40:22 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:40:22 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca2f19-3c25-4269-add9-aff60a1480d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:40:22 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9472a136-fc89-4d0c-8b08-6437153fedd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa] added
Aug 16 06:40:22 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf6a712-cc3a-416b-adc4-62441604d827]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ce755-f9da-4bb5-bd45-5f0928ed657f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnTDYazK {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnTDYazK" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[28088b67-97ac-4a69-93a4-65dd7c696d23]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnTDYazK'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f86656-3975-46e5-ab9c-010b6ecf7953]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b293e3-fc39-44c7-b344-0528dd9924c7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:22 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:22 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad57843-8f9b-4d2b-9c10-ded0c5026c51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa, portal: 172.16.0.220,3260]
Aug 16 06:40:22 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa, portal: 172.16.0.220,3260] successful.
Aug 16 06:40:22 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5167106c-6008-4870-95a4-781e92b1eab6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d4caf9-6d40-4a61-b6d2-52d9810bd64b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:22 user nova-compute[74681]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)
Aug 16 06:40:22 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:22 user nova-compute[74681]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)
Aug 16 06:40:22 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f4ca5-0b8b-47ac-b349-701910f32483]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:22 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:40:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:23 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:40:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnTDYazK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:40:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:40:23 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23732646134623732', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:40:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732646134623732', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:40:23 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:40:23 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:40:23 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:40:23 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:40:23 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:40:23 user nova-compute[74681]:   <serial>87e03352-c218-4fdc-9963-04b8390a25aa</serial>
Aug 16 06:40:23 user nova-compute[74681]: </disk>
Aug 16 06:40:23 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:40:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:40:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:40:24 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No VIF found with MAC fa:16:3e:da:6e:a9, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:40:24 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b002495c-3576-4759-8236-41c5c05503d9 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.928s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Starting instance... {{(pid=74681) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:40:36 user nova-compute[74681]: INFO nova.compute.claims [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Claim successful on node user
Aug 16 06:40:36 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Start building networks asynchronously for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Allocating IP information in the background. {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 06:40:36 user nova-compute[74681]: DEBUG nova.network.neutron [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] allocate_for_instance() {{(pid=74681) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 06:40:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 06:40:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Start building block device mappings for instance. {{(pid=74681) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:37 user nova-compute[74681]: INFO nova.virt.block_device [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Booting with volume a0969aad-24ec-42f0-b93a-6d7fa1a252fe at /dev/vda
Aug 16 06:40:37 user nova-compute[74681]: DEBUG os_brick.utils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4233c1-7eac-4c05-b080-22980a568580]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea26504d-a2f7-4ba2-ad70-745a0901d15c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG nova.policy [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c2a23b359db41c69a813ead8075c709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '804b2801c2f645b8979b9c96099b566e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74681) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a9e738-3495-49c1-82be-29fd1d775c42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[60133063-7f0d-447b-b2b9-2aad17abf202]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:40:37 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:40:37 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[035aea41-db1a-48d4-8d60-3831a8920749]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG os_brick.utils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating existing volume attachment record: bc3bd7ba-6799-4cd7-bc85-9991a11be6e0 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:40:37 user nova-compute[74681]: DEBUG nova.network.neutron [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Successfully created port: 908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 06:40:38 user nova-compute[74681]: DEBUG nova.network.neutron [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Successfully updated port: 908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 06:40:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:40:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:40:38 user nova-compute[74681]: DEBUG nova.network.neutron [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:40:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-089b6744-5238-4d86-98ca-478b52d20780 req-baf7e2f9-0563-4422-8c48-5623f4883c3d service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-changed-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:38 user nova-compute[74681]: DEBUG nova.compute.manager [req-089b6744-5238-4d86-98ca-478b52d20780 req-baf7e2f9-0563-4422-8c48-5623f4883c3d service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing instance network info cache due to event network-changed-908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:40:38 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-089b6744-5238-4d86-98ca-478b52d20780 req-baf7e2f9-0563-4422-8c48-5623f4883c3d service nova] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:40:38 user nova-compute[74681]: DEBUG nova.network.neutron [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance cache missing network info. {{(pid=74681) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 06:40:39 user nova-compute[74681]: DEBUG nova.network.neutron [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:40:39 user nova-compute[74681]: DEBUG nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance network_info: |[{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74681) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 06:40:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-089b6744-5238-4d86-98ca-478b52d20780 req-baf7e2f9-0563-4422-8c48-5623f4883c3d service nova] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:40:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-089b6744-5238-4d86-98ca-478b52d20780 req-baf7e2f9-0563-4422-8c48-5623f4883c3d service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:40:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-089b6744-5238-4d86-98ca-478b52d20780 req-baf7e2f9-0563-4422-8c48-5623f4883c3d service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updated VIF entry in instance network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:40:39 user nova-compute[74681]: DEBUG nova.network.neutron [req-089b6744-5238-4d86-98ca-478b52d20780 req-baf7e2f9-0563-4422-8c48-5623f4883c3d service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:39 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-089b6744-5238-4d86-98ca-478b52d20780 req-baf7e2f9-0563-4422-8c48-5623f4883c3d service nova] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:40:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Start spawning the instance on the hypervisor. {{(pid=74681) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:40:46 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Creating image(s)
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Ensure instance console log exists: /opt/stack/data/nova/instances/50fcfb93-bcaf-4705-b12e-ec04a968ecef/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Start _get_guest_xml network_info=[{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'bc3bd7ba-6799-4cd7-bc85-9991a11be6e0', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRKlYnMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50fcfb93-bcaf-4705-b12e-ec04a968ecef', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0969aad-24ec-42f0-b93a-6d7fa1a252fe', 'serial': 'a0969aad-24ec-42f0-b93a-6d7fa1a252fe'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:40:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:40:46 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRKlYnMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:40:46 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:40:46 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:40:46 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[05789ac8-f483-4d0d-8cd7-c82f213fb4f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:40:46 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[915e2214-33c9-46b8-ae38-9b3e68e22afa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe] added
Aug 16 06:40:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[455af00d-2c9d-400e-851f-c93212079f0f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7ea973-a86c-4c1a-8995-da38c34ef452]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VRKlYnMI {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VRKlYnMI" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f74ec04-1eda-4443-9b0c-6e4a747994e3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VRKlYnMI'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb701aac-1a8d-43dc-a474-1fd25c6da847]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771f526-0d4e-4d23-92e3-a325d4b9e3bf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:46 user nova-compute[74681]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)
Aug 16 06:40:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:46 user nova-compute[74681]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)
Aug 16 06:40:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16bda2-11aa-44c8-b133-4c4e06af28df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260]
Aug 16 06:40:46 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260] successful.
Aug 16 06:40:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb938b-7ccd-4606-86ce-00a47bed5c3f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b239395-321f-4822-9e47-842d3688ac09]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:46 user nova-compute[74681]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)
Aug 16 06:40:46 user nova-compute[74681]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:40:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:46 user nova-compute[74681]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)
Aug 16 06:40:46 user nova-compute[74681]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:40:46 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba2dbdd-1aaf-4e24-a217-873bcab21ad8]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:40:46 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRKlYnMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23035316533393830', 'path': '/dev/sdc'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035316533393830', 'path': '/dev/sdc'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1650441523',display_name='tempest-TestShelveInstance-server-1650441523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1650441523',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS2GPSjsk+n67VfIty9P1LEMeaZk4ywPagHYv14UpkaT/G3b3OfWZe6Yoo91LdO18wTG/PC1Do8cHnrFqZKo0Uhb/6/gpZaqxcGPWnK6oeMEs43QklUkfYgMzXIrUaSNg==',key_name='tempest-TestShelveInstance-1965226434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='804b2801c2f645b8979b9c96099b566e',ramdisk_id='',reservation_id='r-mv2m9fnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-902665066',owner_user_name='tempest-TestShelveInstance-902665066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:40:37Z,user_data=None,user_id='2c2a23b359db41c69a813ead8075c709',uuid=50fcfb93-bcaf-4705-b12e-ec04a968ecef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converting VIF {"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lazy-loading 'pci_devices' on Instance uuid 50fcfb93-bcaf-4705-b12e-ec04a968ecef {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:40:47 user nova-compute[74681]:   <uuid>50fcfb93-bcaf-4705-b12e-ec04a968ecef</uuid>
Aug 16 06:40:47 user nova-compute[74681]:   <name>instance-00000034</name>
Aug 16 06:40:47 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:40:47 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:40:47 user nova-compute[74681]:   <metadata>
Aug 16 06:40:47 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:40:47 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:40:47 user nova-compute[74681]:       <nova:name>tempest-TestShelveInstance-server-1650441523</nova:name>
Aug 16 06:40:47 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:40:46</nova:creationTime>
Aug 16 06:40:47 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:40:47 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:40:47 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:40:47 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:40:47 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:40:47 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:40:47 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:40:47 user nova-compute[74681]:       <nova:owner>
Aug 16 06:40:47 user nova-compute[74681]:         <nova:user uuid="2c2a23b359db41c69a813ead8075c709">tempest-TestShelveInstance-902665066-project-member</nova:user>
Aug 16 06:40:47 user nova-compute[74681]:         <nova:project uuid="804b2801c2f645b8979b9c96099b566e">tempest-TestShelveInstance-902665066</nova:project>
Aug 16 06:40:47 user nova-compute[74681]:       </nova:owner>
Aug 16 06:40:47 user nova-compute[74681]:       <nova:ports>
Aug 16 06:40:47 user nova-compute[74681]:         <nova:port uuid="908eb268-c77b-473d-9f63-10004dd045d1">
Aug 16 06:40:47 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 06:40:47 user nova-compute[74681]:         </nova:port>
Aug 16 06:40:47 user nova-compute[74681]:       </nova:ports>
Aug 16 06:40:47 user nova-compute[74681]:     </nova:instance>
Aug 16 06:40:47 user nova-compute[74681]:   </metadata>
Aug 16 06:40:47 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:40:47 user nova-compute[74681]:     <system>
Aug 16 06:40:47 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:40:47 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:40:47 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:40:47 user nova-compute[74681]:       <entry name="serial">50fcfb93-bcaf-4705-b12e-ec04a968ecef</entry>
Aug 16 06:40:47 user nova-compute[74681]:       <entry name="uuid">50fcfb93-bcaf-4705-b12e-ec04a968ecef</entry>
Aug 16 06:40:47 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:40:47 user nova-compute[74681]:     </system>
Aug 16 06:40:47 user nova-compute[74681]:   </sysinfo>
Aug 16 06:40:47 user nova-compute[74681]:   <os>
Aug 16 06:40:47 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:40:47 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:40:47 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:40:47 user nova-compute[74681]:   </os>
Aug 16 06:40:47 user nova-compute[74681]:   <features>
Aug 16 06:40:47 user nova-compute[74681]:     <acpi/>
Aug 16 06:40:47 user nova-compute[74681]:     <apic/>
Aug 16 06:40:47 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:40:47 user nova-compute[74681]:   </features>
Aug 16 06:40:47 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:40:47 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:40:47 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:40:47 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:40:47 user nova-compute[74681]:   </clock>
Aug 16 06:40:47 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:40:47 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:40:47 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:40:47 user nova-compute[74681]:   </cpu>
Aug 16 06:40:47 user nova-compute[74681]:   <devices>
Aug 16 06:40:47 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:40:47 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:40:47 user nova-compute[74681]:       <source dev="/dev/sdc"/>
Aug 16 06:40:47 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:40:47 user nova-compute[74681]:       <serial>a0969aad-24ec-42f0-b93a-6d7fa1a252fe</serial>
Aug 16 06:40:47 user nova-compute[74681]:     </disk>
Aug 16 06:40:47 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:40:47 user nova-compute[74681]:       <mac address="fa:16:3e:be:06:c5"/>
Aug 16 06:40:47 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:40:47 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:40:47 user nova-compute[74681]:       <target dev="tap908eb268-c7"/>
Aug 16 06:40:47 user nova-compute[74681]:     </interface>
Aug 16 06:40:47 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:40:47 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/50fcfb93-bcaf-4705-b12e-ec04a968ecef/console.log" append="off"/>
Aug 16 06:40:47 user nova-compute[74681]:     </serial>
Aug 16 06:40:47 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:40:47 user nova-compute[74681]:     <video>
Aug 16 06:40:47 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:40:47 user nova-compute[74681]:     </video>
Aug 16 06:40:47 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:40:47 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:40:47 user nova-compute[74681]:     </rng>
Aug 16 06:40:47 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:40:47 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:40:47 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:40:47 user nova-compute[74681]:     </memballoon>
Aug 16 06:40:47 user nova-compute[74681]:   </devices>
Aug 16 06:40:47 user nova-compute[74681]: </domain>
Aug 16 06:40:47 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1650441523',display_name='tempest-TestShelveInstance-server-1650441523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1650441523',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS2GPSjsk+n67VfIty9P1LEMeaZk4ywPagHYv14UpkaT/G3b3OfWZe6Yoo91LdO18wTG/PC1Do8cHnrFqZKo0Uhb/6/gpZaqxcGPWnK6oeMEs43QklUkfYgMzXIrUaSNg==',key_name='tempest-TestShelveInstance-1965226434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='804b2801c2f645b8979b9c96099b566e',ramdisk_id='',reservation_id='r-mv2m9fnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-902665066',owner_user_name='tempest-TestShelveInstance-902665066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T06:40:37Z,user_data=None,user_id='2c2a23b359db41c69a813ead8075c709',uuid=50fcfb93-bcaf-4705-b12e-ec04a968ecef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converting VIF {"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG os_vif [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap908eb268-c7, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap908eb268-c7, col_values=(('external_ids', {'iface-id': '908eb268-c77b-473d-9f63-10004dd045d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:06:c5', 'vm-uuid': '50fcfb93-bcaf-4705-b12e-ec04a968ecef'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:47 user nova-compute[74681]: INFO os_vif [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7')
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:40:47 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] No VIF found with MAC fa:16:3e:be:06:c5, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-28a535a8-7fc2-4b4e-9ce4-3f50acbd4eb4 req-1841ac5d-5002-4b53-ae06-8e932970124e service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-28a535a8-7fc2-4b4e-9ce4-3f50acbd4eb4 req-1841ac5d-5002-4b53-ae06-8e932970124e service nova] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-28a535a8-7fc2-4b4e-9ce4-3f50acbd4eb4 req-1841ac5d-5002-4b53-ae06-8e932970124e service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-28a535a8-7fc2-4b4e-9ce4-3f50acbd4eb4 req-1841ac5d-5002-4b53-ae06-8e932970124e service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-28a535a8-7fc2-4b4e-9ce4-3f50acbd4eb4 req-1841ac5d-5002-4b53-ae06-8e932970124e service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] No waiting events found dispatching network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:40:49 user nova-compute[74681]: WARNING nova.compute.manager [req-28a535a8-7fc2-4b4e-9ce4-3f50acbd4eb4 req-1841ac5d-5002-4b53-ae06-8e932970124e service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received unexpected event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 for instance with vm_state building and task_state spawning.
Aug 16 06:40:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:49 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692168051.3109155, 50fcfb93-bcaf-4705-b12e-ec04a968ecef => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:40:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] VM Resumed (Lifecycle Event)
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:40:51 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance spawned successfully.
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Found default for hw_cdrom_bus of ide {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Found default for hw_disk_bus of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Found default for hw_input_bus of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Found default for hw_pointer_model of None {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Found default for hw_video_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Found default for hw_vif_model of virtio {{(pid=74681) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 06:40:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692168051.311187, 50fcfb93-bcaf-4705-b12e-ec04a968ecef => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:40:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] VM Started (Lifecycle Event)
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:40:51 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:40:51 user nova-compute[74681]: INFO nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-7561aaa2-759f-435e-ba00-5d876cf70775 req-aff82043-fbbb-4fe7-a2da-fa144061d1f8 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7561aaa2-759f-435e-ba00-5d876cf70775 req-aff82043-fbbb-4fe7-a2da-fa144061d1f8 service nova] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7561aaa2-759f-435e-ba00-5d876cf70775 req-aff82043-fbbb-4fe7-a2da-fa144061d1f8 service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-7561aaa2-759f-435e-ba00-5d876cf70775 req-aff82043-fbbb-4fe7-a2da-fa144061d1f8 service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:51 user nova-compute[74681]: DEBUG nova.compute.manager [req-7561aaa2-759f-435e-ba00-5d876cf70775 req-aff82043-fbbb-4fe7-a2da-fa144061d1f8 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] No waiting events found dispatching network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:40:51 user nova-compute[74681]: WARNING nova.compute.manager [req-7561aaa2-759f-435e-ba00-5d876cf70775 req-aff82043-fbbb-4fe7-a2da-fa144061d1f8 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received unexpected event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 for instance with vm_state building and task_state spawning.
Aug 16 06:40:51 user nova-compute[74681]: INFO nova.compute.manager [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Took 15.05 seconds to build instance.
Aug 16 06:40:51 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-abc14fe7-87f4-408a-acb3-2b38ce28f33f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.161s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:53 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:53 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:53 user nova-compute[74681]: INFO nova.compute.manager [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Detaching volume 87e03352-c218-4fdc-9963-04b8390a25aa
Aug 16 06:40:53 user nova-compute[74681]: INFO nova.virt.block_device [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attempting to driver detach volume 87e03352-c218-4fdc-9963-04b8390a25aa from mountpoint /dev/vdb
Aug 16 06:40:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Attempting to detach device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:40:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:40:53 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:40:53 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:40:53 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:40:53 user nova-compute[74681]:   <serial>87e03352-c218-4fdc-9963-04b8390a25aa</serial>
Aug 16 06:40:53 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:40:53 user nova-compute[74681]: </disk>
Aug 16 06:40:53 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:40:53 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully detached device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the persistent domain config.
Aug 16 06:40:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:40:53 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:40:53 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:40:53 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:40:53 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:40:53 user nova-compute[74681]:   <serial>87e03352-c218-4fdc-9963-04b8390a25aa</serial>
Aug 16 06:40:53 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:40:53 user nova-compute[74681]: </disk>
Aug 16 06:40:53 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692168054.0962207, 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:40:54 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully detached device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the live domain config.
Aug 16 06:40:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnTDYazK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:40:54 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cd182b-8f03-4c95-9d26-78cb6d841512]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae73e92f-757c-4f29-ac9b-8e8a40af1a27]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:54 user nova-compute[74681]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)
Aug 16 06:40:54 user nova-compute[74681]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:40:54 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:40:54 user nova-compute[74681]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa (non-flash)
Aug 16 06:40:54 user nova-compute[74681]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:40:54 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94941a2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[32384eca-2168-4f8c-8088-e35ca1b432a3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9092c9e3-47e0-4441-b465-d057446818a0]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab61c3-092d-4159-a958-ad648296946a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b8801-f31e-4b51-99a4-6ff2a476e0c9]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d01a55-2519-45a0-be6b-d0557c2001b5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[354ba7ee-3619-471b-ad27-6c867bd331e7]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa, portal: 172.16.0.220,3260]
Aug 16 06:40:54 user nova-compute[74681]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa, portal: 172.16.0.220,3260] successful.
Aug 16 06:40:54 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87e03352-c218-4fdc-9963-04b8390a25aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac66345-7a62-4d4a-ae92-2209b43e3d7c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== disconnect_volume: return (310ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:40:54 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:40:55 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:40:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7800ddb5-2165-41e6-af21-159c72ea6531 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.710s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "31137824-5fa9-44e3-86ca-5d0587c28454" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:57 user nova-compute[74681]: INFO nova.compute.manager [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Terminating instance
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.compute.manager [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f9fb98c-de92-4d1f-9ad3-46e35240e253 req-7da26528-6cff-4afe-ac4b-8c23f85d14d9 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received event network-vif-unplugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9fb98c-de92-4d1f-9ad3-46e35240e253 req-7da26528-6cff-4afe-ac4b-8c23f85d14d9 service nova] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9fb98c-de92-4d1f-9ad3-46e35240e253 req-7da26528-6cff-4afe-ac4b-8c23f85d14d9 service nova] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-4f9fb98c-de92-4d1f-9ad3-46e35240e253 req-7da26528-6cff-4afe-ac4b-8c23f85d14d9 service nova] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f9fb98c-de92-4d1f-9ad3-46e35240e253 req-7da26528-6cff-4afe-ac4b-8c23f85d14d9 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] No waiting events found dispatching network-vif-unplugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.compute.manager [req-4f9fb98c-de92-4d1f-9ad3-46e35240e253 req-7da26528-6cff-4afe-ac4b-8c23f85d14d9 service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received event network-vif-unplugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:40:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Instance destroyed successfully.
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.objects.instance [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lazy-loading 'resources' on Instance uuid 31137824-5fa9-44e3-86ca-5d0587c28454 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-962543650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-962543650',id=29,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d289f0a66d5047b7b1be8ca5d969eaea',ramdisk_id='',reservation_id='r-050x3wa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:22:27Z,user_data=None,user_id='361d070042c54dd59f7179619de1d1e9',uuid=31137824-5fa9-44e3-86ca-5d0587c28454,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converting VIF {"id": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "address": "fa:16:3e:f6:25:78", "network": {"id": "583720e3-460f-4091-8c2c-7b74f55f92ff", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006441266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d289f0a66d5047b7b1be8ca5d969eaea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de54a-f5", "ovs_interfaceid": "d69de54a-f521-4ad2-95cc-b62e0dc878f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:25:78,bridge_name='br-int',has_traffic_filtering=True,id=d69de54a-f521-4ad2-95cc-b62e0dc878f1,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de54a-f5') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG os_vif [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:25:78,bridge_name='br-int',has_traffic_filtering=True,id=d69de54a-f521-4ad2-95cc-b62e0dc878f1,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de54a-f5') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd69de54a-f5, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:40:57 user nova-compute[74681]: INFO os_vif [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:25:78,bridge_name='br-int',has_traffic_filtering=True,id=d69de54a-f521-4ad2-95cc-b62e0dc878f1,network=Network(583720e3-460f-4091-8c2c-7b74f55f92ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de54a-f5')
Aug 16 06:40:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Deleting instance files /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454_del
Aug 16 06:40:57 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Deletion of /opt/stack/data/nova/instances/31137824-5fa9-44e3-86ca-5d0587c28454_del complete
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:40:57 user nova-compute[74681]: INFO nova.compute.manager [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:40:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:40:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid '31137824-5fa9-44e3-86ca-5d0587c28454' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid '31137824-5fa9-44e3-86ca-5d0587c28454' (instance-0000001d)
Aug 16 06:40:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:40:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:40:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8248MB free_disk=25.20318603515625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:40:58 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Took 0.90 seconds to deallocate network for instance.
Aug 16 06:40:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 31137824-5fa9-44e3-86ca-5d0587c28454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 50fcfb93-bcaf-4705-b12e-ec04a968ecef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:40:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing inventories for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating ProviderTree inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing aggregate associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, aggregates: None {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing trait associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.492s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-bd82a7fe-481d-4027-8a35-04e4355e63aa req-81f365d4-d539-4209-b701-fde0e366333a service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received event network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bd82a7fe-481d-4027-8a35-04e4355e63aa req-81f365d4-d539-4209-b701-fde0e366333a service nova] Acquiring lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bd82a7fe-481d-4027-8a35-04e4355e63aa req-81f365d4-d539-4209-b701-fde0e366333a service nova] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bd82a7fe-481d-4027-8a35-04e4355e63aa req-81f365d4-d539-4209-b701-fde0e366333a service nova] Lock "31137824-5fa9-44e3-86ca-5d0587c28454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-bd82a7fe-481d-4027-8a35-04e4355e63aa req-81f365d4-d539-4209-b701-fde0e366333a service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] No waiting events found dispatching network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:40:59 user nova-compute[74681]: WARNING nova.compute.manager [req-bd82a7fe-481d-4027-8a35-04e4355e63aa req-81f365d4-d539-4209-b701-fde0e366333a service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received unexpected event network-vif-plugged-d69de54a-f521-4ad2-95cc-b62e0dc878f1 for instance with vm_state deleted and task_state None.
Aug 16 06:40:59 user nova-compute[74681]: DEBUG nova.compute.manager [req-bd82a7fe-481d-4027-8a35-04e4355e63aa req-81f365d4-d539-4209-b701-fde0e366333a service nova] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Received event network-vif-deleted-d69de54a-f521-4ad2-95cc-b62e0dc878f1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:40:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:40:59 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Deleted allocations for instance 31137824-5fa9-44e3-86ca-5d0587c28454
Aug 16 06:40:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-664a6e1a-d8a8-4127-a661-774639e2f862 tempest-ServerBootFromVolumeStableRescueTest-2074839932 tempest-ServerBootFromVolumeStableRescueTest-2074839932-project-member] Lock "31137824-5fa9-44e3-86ca-5d0587c28454" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.518s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:01 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:03 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:04 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:41:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:41:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:41:04 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:41:04 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updating instance_info_cache with network_info: [{"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:41:04 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:41:04 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:41:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:41:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 06:41:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] There are 1 instances to clean {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 06:41:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance has had 5 of 5 cleanup attempts {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11142}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-a48b9f7a-d321-4dab-8c06-dc415803a105 req-e573b9ee-edb0-42ee-9633-c251f9ddc04c service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-changed-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-a48b9f7a-d321-4dab-8c06-dc415803a105 req-e573b9ee-edb0-42ee-9633-c251f9ddc04c service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Refreshing instance network info cache due to event network-changed-6d3cb2c3-d799-454b-b948-4344f2bbcf56. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a48b9f7a-d321-4dab-8c06-dc415803a105 req-e573b9ee-edb0-42ee-9633-c251f9ddc04c service nova] Acquiring lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a48b9f7a-d321-4dab-8c06-dc415803a105 req-e573b9ee-edb0-42ee-9633-c251f9ddc04c service nova] Acquired lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.network.neutron [req-a48b9f7a-d321-4dab-8c06-dc415803a105 req-e573b9ee-edb0-42ee-9633-c251f9ddc04c service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Refreshing network info cache for port 6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:07 user nova-compute[74681]: INFO nova.compute.manager [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Terminating instance
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-797f094c-256a-4814-acb2-9a897c8af4ce req-e8a2e143-f66b-4523-be2d-30b43ab3fa0a service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-vif-unplugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-797f094c-256a-4814-acb2-9a897c8af4ce req-e8a2e143-f66b-4523-be2d-30b43ab3fa0a service nova] Acquiring lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-797f094c-256a-4814-acb2-9a897c8af4ce req-e8a2e143-f66b-4523-be2d-30b43ab3fa0a service nova] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-797f094c-256a-4814-acb2-9a897c8af4ce req-e8a2e143-f66b-4523-be2d-30b43ab3fa0a service nova] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-797f094c-256a-4814-acb2-9a897c8af4ce req-e8a2e143-f66b-4523-be2d-30b43ab3fa0a service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] No waiting events found dispatching network-vif-unplugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.compute.manager [req-797f094c-256a-4814-acb2-9a897c8af4ce req-e8a2e143-f66b-4523-be2d-30b43ab3fa0a service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-vif-unplugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.network.neutron [req-a48b9f7a-d321-4dab-8c06-dc415803a105 req-e573b9ee-edb0-42ee-9633-c251f9ddc04c service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updated VIF entry in instance network info cache for port 6d3cb2c3-d799-454b-b948-4344f2bbcf56. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG nova.network.neutron [req-a48b9f7a-d321-4dab-8c06-dc415803a105 req-e573b9ee-edb0-42ee-9633-c251f9ddc04c service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updating instance_info_cache with network_info: [{"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-a48b9f7a-d321-4dab-8c06-dc415803a105 req-e573b9ee-edb0-42ee-9633-c251f9ddc04c service nova] Releasing lock "refresh_cache-1ed765f9-44f0-4aa2-aafc-92aa54a4d348" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:08 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Instance destroyed successfully.
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.objects.instance [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lazy-loading 'resources' on Instance uuid 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577201711',display_name='tempest-TestVolumeBootPattern-server-1577201711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577201711',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvsdmHQKgoctVjSri0fO0mIqWRU7ss5zCQFxSzGILynnzZwaYWrajiq2KLk4VaRcC0kuhlsucv7KRTc9TcCiyapFJYtZtxQH50XEx9CvPyfVKmhAuvioieQLfnx81jAWg==',key_name='tempest-TestVolumeBootPattern-210227181',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:36:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fbbdfedd72a4b38aaa5acd93ac18163',ramdisk_id='',reservation_id='r-q64r2w00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-702107063',owner_user_name='tempest-TestVolumeBootPattern-702107063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:36:20Z,user_data=None,user_id='efd0444b91944ba5b2d1e3c852456964',uuid=1ed765f9-44f0-4aa2-aafc-92aa54a4d348,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converting VIF {"id": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "address": "fa:16:3e:77:1f:87", "network": {"id": "8d2f277c-23bf-4ba7-ad91-64f73b712ea0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1336197643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fbbdfedd72a4b38aaa5acd93ac18163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3cb2c3-d7", "ovs_interfaceid": "6d3cb2c3-d799-454b-b948-4344f2bbcf56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:1f:87,bridge_name='br-int',has_traffic_filtering=True,id=6d3cb2c3-d799-454b-b948-4344f2bbcf56,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3cb2c3-d7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_vif [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:1f:87,bridge_name='br-int',has_traffic_filtering=True,id=6d3cb2c3-d799-454b-b948-4344f2bbcf56,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3cb2c3-d7') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d3cb2c3-d7, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:41:08 user nova-compute[74681]: INFO os_vif [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:1f:87,bridge_name='br-int',has_traffic_filtering=True,id=6d3cb2c3-d799-454b-b948-4344f2bbcf56,network=Network(8d2f277c-23bf-4ba7-ad91-64f73b712ea0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3cb2c3-d7')
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovRBMXix', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:41:08 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab748406-3ef6-4b7c-94ad-5dc573ffc7a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ee1db-5b63-4613-bfcb-96240d99fadd]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:41:08 user nova-compute[74681]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:41:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 (non-flash)
Aug 16 06:41:08 user nova-compute[74681]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:41:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94841ea320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9'): ({'sde'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Removing single pathed devices sde {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a3cfd3-62e7-456f-817f-6dbf88799896]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17b26c9-c1ca-4062-b334-43ab527121ce]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Flushing IO for device /dev/sde {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[938580e2-e9eb-4025-9708-85f6c5e815ff]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f870ed1-5589-4b3a-8335-1fb74617c749]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] SCSI volumes sde have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[22137a8f-6562-4f7c-85e7-0484adba28c0]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[df254414-ce04-46e2-b1f8-9108d311174e]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260]
Aug 16 06:41:08 user nova-compute[74681]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9, portal: 172.16.0.220,3260] successful.
Aug 16 06:41:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce75072-ab3a-450b-b4e9-4ccd5a7abdf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efa1eb8-5d7c-4c18-9319-5223e3413930]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] <== disconnect_volume: return (322ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:41:08 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Deleting instance files /opt/stack/data/nova/instances/1ed765f9-44f0-4aa2-aafc-92aa54a4d348_del
Aug 16 06:41:08 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Deletion of /opt/stack/data/nova/instances/1ed765f9-44f0-4aa2-aafc-92aa54a4d348_del complete
Aug 16 06:41:08 user nova-compute[74681]: INFO nova.compute.manager [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 16 06:41:08 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:41:08 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:41:09 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Took 0.50 seconds to deallocate network for instance.
Aug 16 06:41:09 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-f300b824-8af4-43ab-982b-4f119ebce7d1 req-354bf8d1-02fa-4dc7-b976-660f4da8fcfe service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-vif-deleted-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:41:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-f8d969f8-ea26-43da-8c80-361c06f29ff9 req-f730fc8c-ded5-4566-bca0-40111f3d3cd1 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received event network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:41:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f8d969f8-ea26-43da-8c80-361c06f29ff9 req-f730fc8c-ded5-4566-bca0-40111f3d3cd1 service nova] Acquiring lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f8d969f8-ea26-43da-8c80-361c06f29ff9 req-f730fc8c-ded5-4566-bca0-40111f3d3cd1 service nova] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-f8d969f8-ea26-43da-8c80-361c06f29ff9 req-f730fc8c-ded5-4566-bca0-40111f3d3cd1 service nova] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:09 user nova-compute[74681]: DEBUG nova.compute.manager [req-f8d969f8-ea26-43da-8c80-361c06f29ff9 req-f730fc8c-ded5-4566-bca0-40111f3d3cd1 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] No waiting events found dispatching network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:41:09 user nova-compute[74681]: WARNING nova.compute.manager [req-f8d969f8-ea26-43da-8c80-361c06f29ff9 req-f730fc8c-ded5-4566-bca0-40111f3d3cd1 service nova] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Received unexpected event network-vif-plugged-6d3cb2c3-d799-454b-b948-4344f2bbcf56 for instance with vm_state active and task_state deleting.
Aug 16 06:41:10 user nova-compute[74681]: INFO nova.compute.manager [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Took 1.24 seconds to detach 1 volumes for instance.
Aug 16 06:41:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:10 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:41:10 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:41:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:10 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Deleted allocations for instance 1ed765f9-44f0-4aa2-aafc-92aa54a4d348
Aug 16 06:41:10 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-831bb123-27b2-4e6c-b3b2-3a22069839b3 tempest-TestVolumeBootPattern-702107063 tempest-TestVolumeBootPattern-702107063-project-member] Lock "1ed765f9-44f0-4aa2-aafc-92aa54a4d348" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.345s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:12 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692168057.694756, 31137824-5fa9-44e3-86ca-5d0587c28454 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:41:12 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] VM Stopped (Lifecycle Event)
Aug 16 06:41:12 user nova-compute[74681]: DEBUG nova.compute.manager [None req-ab205a38-6073-4df8-a1dc-49b3d46bd6d2 None None] [instance: 31137824-5fa9-44e3-86ca-5d0587c28454] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:41:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:19 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:19 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74681) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 06:41:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:23 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692168068.06605, 1ed765f9-44f0-4aa2-aafc-92aa54a4d348 => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:41:23 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] VM Stopped (Lifecycle Event)
Aug 16 06:41:23 user nova-compute[74681]: DEBUG nova.compute.manager [None req-a2dd0111-8565-48f0-9e31-8d77d60e136c None None] [instance: 1ed765f9-44f0-4aa2-aafc-92aa54a4d348] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:41:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:41:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:41:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:41:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:47 user nova-compute[74681]: DEBUG nova.objects.instance [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:41:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:47 user nova-compute[74681]: INFO nova.compute.manager [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attaching volume 4a8b4623-10e2-445e-ae28-405ea16c7671 to /dev/vdb
Aug 16 06:41:48 user nova-compute[74681]: DEBUG os_brick.utils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecff47b-1868-4ae3-aef4-2197549f78f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7924e593-7a93-4653-8d76-b50cf010257d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[17963a2c-3e3a-41b3-a0c3-ca8101c2e017]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67a14c0-20b9-4806-b2f1-cacedb776a8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:41:48 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:41:48 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c6dfb-aa69-4085-ac66-0eef2652425d]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG os_brick.utils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating existing volume attachment record: 2ebd5dd4-ff1c-469d-8bc7-a1f7957dab72 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:41:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:50 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:41:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:56 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:41:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pDNkAyGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:41:56 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:41:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:41:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:41:56 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:41:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:41:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:41:56 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:41:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:56 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e6e18-b716-4351-8198-a5c04c05e355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:56 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:41:56 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:56 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b447977-53a2-457e-9451-65650ad9a71a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671] added
Aug 16 06:41:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[329e039a-06d2-47a6-b660-fe3d89fc1128]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fcd7c7-77b9-4f70-abdd-2e88fbeffe65]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pDNkAyGP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pDNkAyGP" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6efc69-66d0-4c50-a463-2449e632f355]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pDNkAyGP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca52558a-d6e8-4539-8b66-1c257d945ec3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[13121d78-e146-493f-b57a-9c0f5d3734f3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:41:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:41:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dbaeeb-0a2c-477d-bcb9-07c8f81f5d64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671, portal: 172.16.0.220,3260]
Aug 16 06:41:57 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671, portal: 172.16.0.220,3260] successful.
Aug 16 06:41:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5fcdac-549e-4223-b477-bafe3f8bf968]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9866514e-030c-4b18-9440-c3d22285fb23]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:41:57 user nova-compute[74681]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 (non-flash)
Aug 16 06:41:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:41:57 user nova-compute[74681]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 (non-flash)
Aug 16 06:41:57 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7e9854-ec70-4d7f-bfd4-abfbb94f54f4]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:41:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:41:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:41:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=25.229141235351562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 50fcfb93-bcaf-4705-b12e-ec04a968ecef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pDNkAyGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26263383439313831', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263383439313831', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.objects.instance [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:41:58 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:41:58 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:41:58 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:41:58 user nova-compute[74681]:   <serial>4a8b4623-10e2-445e-ae28-405ea16c7671</serial>
Aug 16 06:41:58 user nova-compute[74681]: </disk>
Aug 16 06:41:58 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No VIF found with MAC fa:16:3e:da:6e:a9, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:41:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-14e909c5-9999-4420-8aa7-c691b38c0bea tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.930s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:41:59 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:01 user nova-compute[74681]: INFO nova.compute.manager [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Detaching volume 4a8b4623-10e2-445e-ae28-405ea16c7671
Aug 16 06:42:01 user nova-compute[74681]: INFO nova.virt.block_device [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attempting to driver detach volume 4a8b4623-10e2-445e-ae28-405ea16c7671 from mountpoint /dev/vdb
Aug 16 06:42:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Attempting to detach device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:42:01 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:42:01 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:42:01 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:42:01 user nova-compute[74681]:   <serial>4a8b4623-10e2-445e-ae28-405ea16c7671</serial>
Aug 16 06:42:01 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:42:01 user nova-compute[74681]: </disk>
Aug 16 06:42:01 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:42:01 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully detached device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the persistent domain config.
Aug 16 06:42:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:42:01 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:42:01 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:42:01 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:42:01 user nova-compute[74681]:   <serial>4a8b4623-10e2-445e-ae28-405ea16c7671</serial>
Aug 16 06:42:01 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:42:01 user nova-compute[74681]: </disk>
Aug 16 06:42:01 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692168121.7510107, 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:42:01 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully detached device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the live domain config.
Aug 16 06:42:01 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pDNkAyGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:42:01 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d22c89e-72b0-4415-a922-440c6ed6cf3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d3d6ba-c140-49b0-965a-5a8a3c27c3c2]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:42:01 user nova-compute[74681]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 (non-flash)
Aug 16 06:42:01 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:42:01 user nova-compute[74681]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 (non-flash)
Aug 16 06:42:01 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948429df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f2139d-6c40-4d4d-913f-a2e6f703178b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1861eee1-eeb0-4f3c-be84-ba6bc9d61864]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a856ebde-caff-4b39-bf8c-d756ae13c9a9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[96417b4a-2d92-421b-86cd-9b2ab333db57]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[da718961-6ee3-48f5-9c5b-f196f0196954]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:42:01 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[335827ca-19dd-4af4-9b30-c532702dd29f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671, portal: 172.16.0.220,3260]
Aug 16 06:42:02 user nova-compute[74681]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671, portal: 172.16.0.220,3260] successful.
Aug 16 06:42:02 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a8b4623-10e2-445e-ae28-405ea16c7671 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[62691484-c93e-4aec-bb9d-78603b918238]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== disconnect_volume: return (267ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG nova.objects.instance [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:42:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-49f1896d-b1d6-49bf-b029-091841263569 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.518s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:42:03 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:03 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:42:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:42:08 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:08 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:42:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:42:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:11 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:42:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:42:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-59639e40-d729-43e3-b1ef-01b2a6b2fef0 req-d9ce508e-91a9-4dd3-980f-58af58ac9244 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-changed-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:42:28 user nova-compute[74681]: DEBUG nova.compute.manager [req-59639e40-d729-43e3-b1ef-01b2a6b2fef0 req-d9ce508e-91a9-4dd3-980f-58af58ac9244 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing instance network info cache due to event network-changed-908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:42:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59639e40-d729-43e3-b1ef-01b2a6b2fef0 req-d9ce508e-91a9-4dd3-980f-58af58ac9244 service nova] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:42:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59639e40-d729-43e3-b1ef-01b2a6b2fef0 req-d9ce508e-91a9-4dd3-980f-58af58ac9244 service nova] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:42:28 user nova-compute[74681]: DEBUG nova.network.neutron [req-59639e40-d729-43e3-b1ef-01b2a6b2fef0 req-d9ce508e-91a9-4dd3-980f-58af58ac9244 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:29 user nova-compute[74681]: INFO nova.compute.manager [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Shelve offloading
Aug 16 06:42:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-59639e40-d729-43e3-b1ef-01b2a6b2fef0 req-d9ce508e-91a9-4dd3-980f-58af58ac9244 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updated VIF entry in instance network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG nova.network.neutron [req-59639e40-d729-43e3-b1ef-01b2a6b2fef0 req-d9ce508e-91a9-4dd3-980f-58af58ac9244 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-59639e40-d729-43e3-b1ef-01b2a6b2fef0 req-d9ce508e-91a9-4dd3-980f-58af58ac9244 service nova] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-e7ebc947-161c-4ba0-b430-5d073c14e46f req-6499e864-9632-4c13-b4ef-d28ac32cb376 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-unplugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e7ebc947-161c-4ba0-b430-5d073c14e46f req-6499e864-9632-4c13-b4ef-d28ac32cb376 service nova] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e7ebc947-161c-4ba0-b430-5d073c14e46f req-6499e864-9632-4c13-b4ef-d28ac32cb376 service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-e7ebc947-161c-4ba0-b430-5d073c14e46f req-6499e864-9632-4c13-b4ef-d28ac32cb376 service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG nova.compute.manager [req-e7ebc947-161c-4ba0-b430-5d073c14e46f req-6499e864-9632-4c13-b4ef-d28ac32cb376 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] No waiting events found dispatching network-vif-unplugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:42:29 user nova-compute[74681]: WARNING nova.compute.manager [req-e7ebc947-161c-4ba0-b430-5d073c14e46f req-6499e864-9632-4c13-b4ef-d28ac32cb376 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received unexpected event network-vif-unplugged-908eb268-c77b-473d-9f63-10004dd045d1 for instance with vm_state active and task_state shelving.
Aug 16 06:42:29 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance destroyed successfully.
Aug 16 06:42:29 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:42:29 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:42:30 user nova-compute[74681]: DEBUG nova.network.neutron [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:42:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:42:30 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance destroyed successfully.
Aug 16 06:42:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lazy-loading 'resources' on Instance uuid 50fcfb93-bcaf-4705-b12e-ec04a968ecef {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1650441523',display_name='tempest-TestShelveInstance-server-1650441523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1650441523',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS2GPSjsk+n67VfIty9P1LEMeaZk4ywPagHYv14UpkaT/G3b3OfWZe6Yoo91LdO18wTG/PC1Do8cHnrFqZKo0Uhb/6/gpZaqxcGPWnK6oeMEs43QklUkfYgMzXIrUaSNg==',key_name='tempest-TestShelveInstance-1965226434',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='804b2801c2f645b8979b9c96099b566e',ramdisk_id='',reservation_id='r-mv2m9fnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-902665066',owner_user_name='tempest-TestShelveInstance-902665066-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:40:52Z,user_data=None,user_id='2c2a23b359db41c69a813ead8075c709',uuid=50fcfb93-bcaf-4705-b12e-ec04a968ecef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converting VIF {"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_vif [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap908eb268-c7, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:42:31 user nova-compute[74681]: INFO os_vif [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7')
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRKlYnMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:42:31 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[532499ba-8766-437d-b0d3-c2fbad9604cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2ab20b-2939-4e9f-a55c-e838565042e8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:42:31 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:42:31 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f948427c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe'): ({'sdc'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Removing single pathed devices sdc {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-71d2aed4-1094-4188-a242-3174a50f10c1 req-bfe3e27b-b74a-4d4f-90a7-dc0b6f077f24 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-changed-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-71d2aed4-1094-4188-a242-3174a50f10c1 req-bfe3e27b-b74a-4d4f-90a7-dc0b6f077f24 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing instance network info cache due to event network-changed-908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71d2aed4-1094-4188-a242-3174a50f10c1 req-bfe3e27b-b74a-4d4f-90a7-dc0b6f077f24 service nova] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71d2aed4-1094-4188-a242-3174a50f10c1 req-bfe3e27b-b74a-4d4f-90a7-dc0b6f077f24 service nova] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-71d2aed4-1094-4188-a242-3174a50f10c1 req-bfe3e27b-b74a-4d4f-90a7-dc0b6f077f24 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6caad4-eb53-4a4a-8975-0f73852067b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6684cec5-89b5-41cf-8397-77fbbd700abc]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Flushing IO for device /dev/sdc {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d34dcd-9019-4b16-9575-6303818b31eb]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d21a7e3-58ef-45da-8e9b-f89acc12f2c2]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] SCSI volumes sdc have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e965980d-a663-45fe-bb92-9412fd44704e]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e991dafd-f030-457f-b66f-c26cf9bc3e06]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260]
Aug 16 06:42:31 user nova-compute[74681]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260] successful.
Aug 16 06:42:31 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[be852024-e52d-4637-8277-5b1c4f81de07]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] <== disconnect_volume: return (276ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:42:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Deleting instance files /opt/stack/data/nova/instances/50fcfb93-bcaf-4705-b12e-ec04a968ecef_del
Aug 16 06:42:31 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Deletion of /opt/stack/data/nova/instances/50fcfb93-bcaf-4705-b12e-ec04a968ecef_del complete
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-68bc9695-7303-4b81-a800-8810f4d8d19b req-77fa9112-a122-4214-9305-153a0f490b9f service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68bc9695-7303-4b81-a800-8810f4d8d19b req-77fa9112-a122-4214-9305-153a0f490b9f service nova] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68bc9695-7303-4b81-a800-8810f4d8d19b req-77fa9112-a122-4214-9305-153a0f490b9f service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-68bc9695-7303-4b81-a800-8810f4d8d19b req-77fa9112-a122-4214-9305-153a0f490b9f service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-68bc9695-7303-4b81-a800-8810f4d8d19b req-77fa9112-a122-4214-9305-153a0f490b9f service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] No waiting events found dispatching network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:42:31 user nova-compute[74681]: WARNING nova.compute.manager [req-68bc9695-7303-4b81-a800-8810f4d8d19b req-77fa9112-a122-4214-9305-153a0f490b9f service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received unexpected event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 for instance with vm_state active and task_state shelving.
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-71d2aed4-1094-4188-a242-3174a50f10c1 req-bfe3e27b-b74a-4d4f-90a7-dc0b6f077f24 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updated VIF entry in instance network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG nova.network.neutron [req-71d2aed4-1094-4188-a242-3174a50f10c1 req-bfe3e27b-b74a-4d4f-90a7-dc0b6f077f24 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": null, "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap908eb268-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:42:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-71d2aed4-1094-4188-a242-3174a50f10c1 req-bfe3e27b-b74a-4d4f-90a7-dc0b6f077f24 service nova] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:42:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:32 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Deleted allocations for instance 50fcfb93-bcaf-4705-b12e-ec04a968ecef
Aug 16 06:42:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lazy-loading 'numa_topology' on Instance uuid 50fcfb93-bcaf-4705-b12e-ec04a968ecef {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:42:32 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:42:32 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:42:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:42:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-2816418d-6eb8-4241-b1df-efcb83bb1981 tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.586s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:42:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:44 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692168149.795737, 50fcfb93-bcaf-4705-b12e-ec04a968ecef => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:42:44 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] VM Stopped (Lifecycle Event)
Aug 16 06:42:44 user nova-compute[74681]: DEBUG nova.compute.manager [None req-9a9c30c7-4cb8-4fb9-b184-463a499c620c None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:42:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:42:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:55 user nova-compute[74681]: INFO nova.compute.manager [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attaching volume 957a93be-5127-4a21-b008-c5ef9fd1cbdf to /dev/vdb
Aug 16 06:42:55 user nova-compute[74681]: DEBUG os_brick.utils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ee7828-994b-4ff3-acb2-8c1a74196caf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae99c71c-7c48-43b3-8b32-c42f1a4687cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[24febe11-cfa5-433a-88bf-8b14895b0208]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e2b397-2ac6-41cf-bc9e-fccc25626783]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:42:55 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:42:55 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef956727-9629-4c68-ac7f-ca69f9a09d86]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG os_brick.utils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:42:55 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating existing volume attachment record: 9e138478-af4f-4f8b-9b4c-f10c0ed843df {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:42:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:42:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:42:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:42:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:42:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:42:57 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:42:57 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:42:57 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=25.226226806640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:42:57 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:42:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:42:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:42:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:42:58 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:42:58 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:42:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:42:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:43:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:03 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRDEzyVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:43:04 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:43:04 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:43:04 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc763e7e-6047-4360-8816-0fd15eedf771]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:43:04 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cb2a14-328e-458c-b9c7-b6e72fb66221]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf] added
Aug 16 06:43:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d84c479-0009-459b-8e46-58f153397765]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec72ec-e92b-41d6-9e2d-3622c970571b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRDEzyVT {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRDEzyVT" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64b3e97-e2d2-401a-a80f-93712411e372]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRDEzyVT'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a656c6a-e815-48f4-a1f0-56489221b60c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a794a047-8fa7-488f-82b3-acd022f1d3c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:43:04 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:43:04 user nova-compute[74681]:  {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:43:04 user nova-compute[74681]: WARNING os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 06:43:04 user nova-compute[74681]: 
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfc8400-b2d2-447a-b22a-e9bb096575d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf, portal: 172.16.0.220,3260]
Aug 16 06:43:04 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf, portal: 172.16.0.220,3260] successful.
Aug 16 06:43:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[351a611a-5dfa-4837-bda9-ebce47c84c9f]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f0e443-fb80-4580-b75b-ad57b77b6f0a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf (non-flash)
Aug 16 06:43:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf (non-flash)
Aug 16 06:43:04 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[d119d201-b75a-4dac-a94a-2ee012780cad]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:04 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:43:05 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:05 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:43:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRDEzyVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:43:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:43:05 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23365623033353764', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:43:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365623033353764', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:43:05 user nova-compute[74681]: DEBUG nova.objects.instance [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:43:05 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:43:05 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:43:05 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:43:05 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:43:05 user nova-compute[74681]:   <serial>957a93be-5127-4a21-b008-c5ef9fd1cbdf</serial>
Aug 16 06:43:05 user nova-compute[74681]: </disk>
Aug 16 06:43:05 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No VIF found with MAC fa:16:3e:da:6e:a9, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-a66261e4-3824-4a4a-a002-ac7e329c8b2e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.610s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:43:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:43:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:43:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:43:08 user nova-compute[74681]: INFO nova.compute.manager [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Detaching volume 957a93be-5127-4a21-b008-c5ef9fd1cbdf
Aug 16 06:43:08 user nova-compute[74681]: INFO nova.virt.block_device [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attempting to driver detach volume 957a93be-5127-4a21-b008-c5ef9fd1cbdf from mountpoint /dev/vdb
Aug 16 06:43:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Attempting to detach device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:43:08 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:43:08 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:43:08 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:43:08 user nova-compute[74681]:   <serial>957a93be-5127-4a21-b008-c5ef9fd1cbdf</serial>
Aug 16 06:43:08 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:43:08 user nova-compute[74681]: </disk>
Aug 16 06:43:08 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:43:08 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully detached device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the persistent domain config.
Aug 16 06:43:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:43:08 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:43:08 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:43:08 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:43:08 user nova-compute[74681]:   <serial>957a93be-5127-4a21-b008-c5ef9fd1cbdf</serial>
Aug 16 06:43:08 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:43:08 user nova-compute[74681]: </disk>
Aug 16 06:43:08 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692168188.6658814, 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:43:08 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully detached device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the live domain config.
Aug 16 06:43:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRDEzyVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:43:08 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[548b2804-6774-4bef-b3c4-0fa053d72e0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e972f-f87f-4588-a1f9-f176c35ea71a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf (non-flash)
Aug 16 06:43:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf (non-flash)
Aug 16 06:43:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94606ad6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[379daa53-2b42-4225-b75b-86ea433ddc7e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[662f5537-5eca-4695-a639-8b430b75cc0b]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec214f-49ae-4851-93ad-c0765dd3288c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[796494b0-10dd-4dc6-8179-0d1d2be8865c]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd62d6a-98bc-4946-ac6e-d724f41a2d2c]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40331c3-cc10-473a-b714-dcaa59e32680]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf, portal: 172.16.0.220,3260]
Aug 16 06:43:08 user nova-compute[74681]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf, portal: 172.16.0.220,3260] successful.
Aug 16 06:43:08 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957a93be-5127-4a21-b008-c5ef9fd1cbdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42804f6-0b36-47bc-af0b-bef2996f7670]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== disconnect_volume: return (257ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:43:08 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:43:09 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:43:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b200f2d2-685d-4ef7-aa43-d609f6bb2a56 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.696s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:43:10 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:10 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:43:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:13 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:43:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:43:36 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:44 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:46 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:51 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:43:54 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:56 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:43:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:43:58 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:43:58 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=25.216243743896484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:43:58 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:43:59 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:43:59 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:43:59 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:43:59 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:43:59 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:43:59 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:43:59 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:01 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:44:02 user nova-compute[74681]: INFO nova.compute.manager [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attaching volume aa7f4ffa-c29b-4620-abc8-35d5536f68f3 to /dev/vdb
Aug 16 06:44:02 user nova-compute[74681]: DEBUG os_brick.utils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[611d43bc-38f0-410f-84c8-e5656d441f6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdbae65-fe11-4a23-91e8-cf4d38545654]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46b73f5-f1ed-4f25-97f3-6c9ab5ddd7c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b1fce7-8a61-4362-9f1c-110b1c6a1ab2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:44:02 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:44:02 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[826536a6-b351-4b11-93ad-fc3c43ff534b]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG os_brick.utils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:44:02 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating existing volume attachment record: 5215263a-32a1-48ce-bbf5-a355a84a860c {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:44:03 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:04 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:44:06 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:44:07 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLBYoUiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:44:11 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:44:11 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:44:11 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db1daa3-f2f8-4614-aafe-ead73886a1df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:44:11 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a726d503-a43f-49d4-a42f-bcf18a17f2d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3] added
Aug 16 06:44:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[94810041-a6e0-4cfe-a5e0-7d33ff9ea329]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[22897e71-5fd7-4818-b1b7-d89ad21cffb9]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLBYoUiG {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLBYoUiG" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0d156-ca69-4d8a-8f09-4f5fbc97bf70]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DLBYoUiG'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[344ee8f9-81e1-4d4e-9d30-ef1955ccca04]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32dc97c-fe6b-46ba-b71f-8e26421ea0bb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:44:11 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:44:11 user nova-compute[74681]:  {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:44:11 user nova-compute[74681]: WARNING os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 06:44:11 user nova-compute[74681]: 
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6299b1-d65a-487a-aedd-a79036851ebd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3, portal: 172.16.0.220,3260]
Aug 16 06:44:11 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3, portal: 172.16.0.220,3260] successful.
Aug 16 06:44:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a13e748-6ab0-43f6-a540-84a63079383a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb6e4ad-fce7-4b53-b279-f2002e3386fd]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 (non-flash)
Aug 16 06:44:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 (non-flash)
Aug 16 06:44:11 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[5261d529-0b0d-432f-b537-025f62e3a1e8]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:11 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:44:12 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:44:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLBYoUiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:44:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:44:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23664396434336331', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:44:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664396434336331', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:44:12 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:44:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 06:44:12 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:44:12 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:44:12 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:44:12 user nova-compute[74681]:   <serial>aa7f4ffa-c29b-4620-abc8-35d5536f68f3</serial>
Aug 16 06:44:12 user nova-compute[74681]: </disk>
Aug 16 06:44:12 user nova-compute[74681]:  {{(pid=74681) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 06:44:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:44:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:44:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] No VIF found with MAC fa:16:3e:da:6e:a9, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:44:13 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7c35b3b7-72e1-4b1a-b4f8-9dfd149448d6 tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.806s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:14 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:44:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:44:15 user nova-compute[74681]: INFO nova.compute.manager [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Detaching volume aa7f4ffa-c29b-4620-abc8-35d5536f68f3
Aug 16 06:44:15 user nova-compute[74681]: INFO nova.virt.block_device [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Attempting to driver detach volume aa7f4ffa-c29b-4620-abc8-35d5536f68f3 from mountpoint /dev/vdb
Aug 16 06:44:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Attempting to detach device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the persistent domain config. {{(pid=74681) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 06:44:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:44:15 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:44:15 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:44:15 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:44:15 user nova-compute[74681]:   <serial>aa7f4ffa-c29b-4620-abc8-35d5536f68f3</serial>
Aug 16 06:44:15 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:44:15 user nova-compute[74681]: </disk>
Aug 16 06:44:15 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:44:15 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully detached device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the persistent domain config.
Aug 16 06:44:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the live domain config. {{(pid=74681) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 06:44:15 user nova-compute[74681]: DEBUG nova.virt.libvirt.guest [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 06:44:15 user nova-compute[74681]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:44:15 user nova-compute[74681]:   <source dev="/dev/sdb"/>
Aug 16 06:44:15 user nova-compute[74681]:   <target dev="vdb" bus="virtio"/>
Aug 16 06:44:15 user nova-compute[74681]:   <serial>aa7f4ffa-c29b-4620-abc8-35d5536f68f3</serial>
Aug 16 06:44:15 user nova-compute[74681]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 06:44:15 user nova-compute[74681]: </disk>
Aug 16 06:44:15 user nova-compute[74681]:  {{(pid=74681) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Received event <DeviceRemovedEvent: 1692168256.239179, 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=74681) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 06:44:16 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully detached device vdb from instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d from the live domain config.
Aug 16 06:44:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLBYoUiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:44:16 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad30855-d523-4bd2-ac7d-71b49d7d3b9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa996c06-a692-48a5-abf0-eb498403aef2]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 (non-flash)
Aug 16 06:44:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 (non-flash)
Aug 16 06:44:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94606d30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33aa652-c2c2-434a-a8b9-65cd32829fa1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be3e676-f7ab-43f2-b28e-cf626efffe7f]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e0a644-94e1-4e8f-bd2d-a999a33af4ae]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[40178079-0bba-48bb-9fbd-0fe2ee384048]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfbc68b-e318-4319-9ac9-aeeea66ffca5]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b3e0dc-54c3-488d-8f6f-4a2bc6fcae41]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3, portal: 172.16.0.220,3260]
Aug 16 06:44:16 user nova-compute[74681]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3, portal: 172.16.0.220,3260] successful.
Aug 16 06:44:16 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa7f4ffa-c29b-4620-abc8-35d5536f68f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[402015a1-d7c4-4c1d-9aed-8e2e3e508bd6]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] <== disconnect_volume: return (294ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:44:16 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:44:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:17 user nova-compute[74681]: DEBUG nova.objects.instance [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'flavor' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:44:17 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-75a2330a-83a6-463a-ac16-5295dda1ce9e tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.620s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:44:20 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:44:20 user nova-compute[74681]: INFO nova.compute.manager [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Unshelving
Aug 16 06:44:20 user nova-compute[74681]: INFO nova.virt.block_device [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Booting with volume a0969aad-24ec-42f0-b93a-6d7fa1a252fe at /dev/vda
Aug 16 06:44:20 user nova-compute[74681]: DEBUG os_brick.utils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:44:20 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3057cafe-a899-443b-8078-813585e71ea9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b37fe27750f8\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e231a-67ac-4e0b-8062-3839fbc1b06c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[feebe253-4d86-47e4-849e-eecffcb3cb47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd2e771-9799-413e-bf0e-bacadea19efe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Running cmd (subprocess): nvme version {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] 'nvme version' failed. Not Retrying. {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] nvme not present on system {{(pid=74681) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 06:44:21 user nova-compute[74681]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 06:44:21 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[252181c7-ed8c-4d4f-89de-d2d16973cffd]: (4, '') {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74681) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.lightos [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] LIGHTOS: no hostnqn found. {{(pid=74681) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG os_brick.utils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b37fe27750f8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:44:21 user nova-compute[74681]: DEBUG nova.virt.block_device [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating existing volume attachment record: 15cf7598-820b-430a-b704-ebc60f4df4b5 {{(pid=74681) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 06:44:26 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:44:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:44:29 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:44:29 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lazy-loading 'pci_requests' on Instance uuid 50fcfb93-bcaf-4705-b12e-ec04a968ecef {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:44:30 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lazy-loading 'numa_topology' on Instance uuid 50fcfb93-bcaf-4705-b12e-ec04a968ecef {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:44:30 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74681) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 06:44:30 user nova-compute[74681]: INFO nova.compute.claims [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Claim successful on node user
Aug 16 06:44:30 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:44:30 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:44:30 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:30 user nova-compute[74681]: INFO nova.network.neutron [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating port 908eb268-c77b-473d-9f63-10004dd045d1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 06:44:30 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:31 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:44:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:44:31 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Building network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 06:44:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-78552b68-f7b1-4b6f-9a2f-36b51614e81a req-1d349fdf-71f0-43e5-8b3f-b8b4b0f1af2a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-changed-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:44:31 user nova-compute[74681]: DEBUG nova.compute.manager [req-78552b68-f7b1-4b6f-9a2f-36b51614e81a req-1d349fdf-71f0-43e5-8b3f-b8b4b0f1af2a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing instance network info cache due to event network-changed-908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:44:31 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78552b68-f7b1-4b6f-9a2f-36b51614e81a req-1d349fdf-71f0-43e5-8b3f-b8b4b0f1af2a service nova] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.network.neutron [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Creating instance directory {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 06:44:32 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Creating image(s)
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Did not create local disks {{(pid=74681) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Ensure instance console log exists: /opt/stack/data/nova/instances/50fcfb93-bcaf-4705-b12e-ec04a968ecef/console.log {{(pid=74681) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Start _get_guest_xml network_info=[{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '15cf7598-820b-430a-b704-ebc60f4df4b5', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRKlYnMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50fcfb93-bcaf-4705-b12e-ec04a968ecef', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0969aad-24ec-42f0-b93a-6d7fa1a252fe', 'serial': 'a0969aad-24ec-42f0-b93a-6d7fa1a252fe'}, 'volume_type': None} {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78552b68-f7b1-4b6f-9a2f-36b51614e81a req-1d349fdf-71f0-43e5-8b3f-b8b4b0f1af2a service nova] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-78552b68-f7b1-4b6f-9a2f-36b51614e81a req-1d349fdf-71f0-43e5-8b3f-b8b4b0f1af2a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:44:32 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:44:32 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] CPU controller missing on host. {{(pid=74681) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.host [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] CPU controller found on host. {{(pid=74681) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74681) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T06:05:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Flavor limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Image limits 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Flavor pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Image pref 0:0:0 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Got 1 possible topologies {{(pid=74681) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.hardware [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74681) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lazy-loading 'vcpu_model' on Instance uuid 50fcfb93-bcaf-4705-b12e-ec04a968ecef {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Calling os-brick to attach iSCSI Volume {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRKlYnMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:44:32 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:44:32 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:44:32 user nova-compute[74681]: INFO os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bf6086-47cf-4b1c-ac5f-e5335683207b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 06:44:32 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --interface default --op new {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b50ae1d-8a07-49ed-87c1-4d6d500f416f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe] added\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe] added
Aug 16 06:44:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a54ba8d-e613-4388-91c0-8fd51c1ddd6b]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[0145db82-66de-4f2a-8565-a4edccd7e6f3]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VRKlYnMI {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VRKlYnMI" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2309f9-a6a4-4e2a-873b-2695bf6f89b2]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VRKlYnMI'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[962495d0-d578-4787-a244-77f0bbba341a]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce16345d-b392-4611-aa97-1330902e2b3b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:44:32 user nova-compute[74681]:  {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 06:44:32 user nova-compute[74681]:  {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:44:32 user nova-compute[74681]: WARNING os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 06:44:32 user nova-compute[74681]: 
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --login {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c5ccd1-a561-43ed-ba3f-e2699ebb2dcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260]
Aug 16 06:44:32 user nova-compute[74681]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260] successful.
Aug 16 06:44:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[a865d2aa-f52e-4a54-a729-2c999d6a6594]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[088324b4-e262-4fb0-b737-44df7d7e77a2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:44:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:44:32 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Connected to 172.16.0.220:3260 {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74681) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74681) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d66dcda-1c2d-4466-b38b-8d3d2d78963e]: (4, ('- - 0', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74681) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRKlYnMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=74681) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-78552b68-f7b1-4b6f-9a2f-36b51614e81a req-1d349fdf-71f0-43e5-8b3f-b8b4b0f1af2a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updated VIF entry in instance network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG nova.network.neutron [req-78552b68-f7b1-4b6f-9a2f-36b51614e81a req-1d349fdf-71f0-43e5-8b3f-b8b4b0f1af2a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:44:32 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-78552b68-f7b1-4b6f-9a2f-36b51614e81a req-1d349fdf-71f0-43e5-8b3f-b8b4b0f1af2a service nova] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23035316533393830', 'path': '/dev/sdb'} {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035316533393830', 'path': '/dev/sdb'} {{(pid=74681) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1650441523',display_name='tempest-TestShelveInstance-server-1650441523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1650441523',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1965226434',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='804b2801c2f645b8979b9c96099b566e',ramdisk_id='',reservation_id='r-mv2m9fnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-902665066',owner_user_name='tempest-TestShelveInstance-902665066-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:44:21Z,user_data=None,user_id='2c2a23b359db41c69a813ead8075c709',uuid=50fcfb93-bcaf-4705-b12e-ec04a968ecef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74681) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converting VIF {"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lazy-loading 'pci_devices' on Instance uuid 50fcfb93-bcaf-4705-b12e-ec04a968ecef {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] End _get_guest_xml xml=<domain type="kvm">
Aug 16 06:44:33 user nova-compute[74681]:   <uuid>50fcfb93-bcaf-4705-b12e-ec04a968ecef</uuid>
Aug 16 06:44:33 user nova-compute[74681]:   <name>instance-00000034</name>
Aug 16 06:44:33 user nova-compute[74681]:   <memory>524288</memory>
Aug 16 06:44:33 user nova-compute[74681]:   <vcpu>1</vcpu>
Aug 16 06:44:33 user nova-compute[74681]:   <metadata>
Aug 16 06:44:33 user nova-compute[74681]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 06:44:33 user nova-compute[74681]:       <nova:package version="0.0.0"/>
Aug 16 06:44:33 user nova-compute[74681]:       <nova:name>tempest-TestShelveInstance-server-1650441523</nova:name>
Aug 16 06:44:33 user nova-compute[74681]:       <nova:creationTime>2023-08-16 06:44:32</nova:creationTime>
Aug 16 06:44:33 user nova-compute[74681]:       <nova:flavor name="m1.tiny">
Aug 16 06:44:33 user nova-compute[74681]:         <nova:memory>512</nova:memory>
Aug 16 06:44:33 user nova-compute[74681]:         <nova:disk>1</nova:disk>
Aug 16 06:44:33 user nova-compute[74681]:         <nova:swap>0</nova:swap>
Aug 16 06:44:33 user nova-compute[74681]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 06:44:33 user nova-compute[74681]:         <nova:vcpus>1</nova:vcpus>
Aug 16 06:44:33 user nova-compute[74681]:       </nova:flavor>
Aug 16 06:44:33 user nova-compute[74681]:       <nova:owner>
Aug 16 06:44:33 user nova-compute[74681]:         <nova:user uuid="2c2a23b359db41c69a813ead8075c709">tempest-TestShelveInstance-902665066-project-member</nova:user>
Aug 16 06:44:33 user nova-compute[74681]:         <nova:project uuid="804b2801c2f645b8979b9c96099b566e">tempest-TestShelveInstance-902665066</nova:project>
Aug 16 06:44:33 user nova-compute[74681]:       </nova:owner>
Aug 16 06:44:33 user nova-compute[74681]:       <nova:ports>
Aug 16 06:44:33 user nova-compute[74681]:         <nova:port uuid="908eb268-c77b-473d-9f63-10004dd045d1">
Aug 16 06:44:33 user nova-compute[74681]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 06:44:33 user nova-compute[74681]:         </nova:port>
Aug 16 06:44:33 user nova-compute[74681]:       </nova:ports>
Aug 16 06:44:33 user nova-compute[74681]:     </nova:instance>
Aug 16 06:44:33 user nova-compute[74681]:   </metadata>
Aug 16 06:44:33 user nova-compute[74681]:   <sysinfo type="smbios">
Aug 16 06:44:33 user nova-compute[74681]:     <system>
Aug 16 06:44:33 user nova-compute[74681]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 06:44:33 user nova-compute[74681]:       <entry name="product">OpenStack Nova</entry>
Aug 16 06:44:33 user nova-compute[74681]:       <entry name="version">0.0.0</entry>
Aug 16 06:44:33 user nova-compute[74681]:       <entry name="serial">50fcfb93-bcaf-4705-b12e-ec04a968ecef</entry>
Aug 16 06:44:33 user nova-compute[74681]:       <entry name="uuid">50fcfb93-bcaf-4705-b12e-ec04a968ecef</entry>
Aug 16 06:44:33 user nova-compute[74681]:       <entry name="family">Virtual Machine</entry>
Aug 16 06:44:33 user nova-compute[74681]:     </system>
Aug 16 06:44:33 user nova-compute[74681]:   </sysinfo>
Aug 16 06:44:33 user nova-compute[74681]:   <os>
Aug 16 06:44:33 user nova-compute[74681]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 06:44:33 user nova-compute[74681]:     <boot dev="hd"/>
Aug 16 06:44:33 user nova-compute[74681]:     <smbios mode="sysinfo"/>
Aug 16 06:44:33 user nova-compute[74681]:   </os>
Aug 16 06:44:33 user nova-compute[74681]:   <features>
Aug 16 06:44:33 user nova-compute[74681]:     <acpi/>
Aug 16 06:44:33 user nova-compute[74681]:     <apic/>
Aug 16 06:44:33 user nova-compute[74681]:     <vmcoreinfo/>
Aug 16 06:44:33 user nova-compute[74681]:   </features>
Aug 16 06:44:33 user nova-compute[74681]:   <clock offset="utc">
Aug 16 06:44:33 user nova-compute[74681]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 06:44:33 user nova-compute[74681]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 06:44:33 user nova-compute[74681]:     <timer name="hpet" present="no"/>
Aug 16 06:44:33 user nova-compute[74681]:   </clock>
Aug 16 06:44:33 user nova-compute[74681]:   <cpu mode="custom" match="exact">
Aug 16 06:44:33 user nova-compute[74681]:     <model>Nehalem</model>
Aug 16 06:44:33 user nova-compute[74681]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 06:44:33 user nova-compute[74681]:   </cpu>
Aug 16 06:44:33 user nova-compute[74681]:   <devices>
Aug 16 06:44:33 user nova-compute[74681]:     <disk type="block" device="disk">
Aug 16 06:44:33 user nova-compute[74681]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 06:44:33 user nova-compute[74681]:       <source dev="/dev/sdb"/>
Aug 16 06:44:33 user nova-compute[74681]:       <target dev="vda" bus="virtio"/>
Aug 16 06:44:33 user nova-compute[74681]:       <serial>a0969aad-24ec-42f0-b93a-6d7fa1a252fe</serial>
Aug 16 06:44:33 user nova-compute[74681]:     </disk>
Aug 16 06:44:33 user nova-compute[74681]:     <interface type="ethernet">
Aug 16 06:44:33 user nova-compute[74681]:       <mac address="fa:16:3e:be:06:c5"/>
Aug 16 06:44:33 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:44:33 user nova-compute[74681]:       <mtu size="1442"/>
Aug 16 06:44:33 user nova-compute[74681]:       <target dev="tap908eb268-c7"/>
Aug 16 06:44:33 user nova-compute[74681]:     </interface>
Aug 16 06:44:33 user nova-compute[74681]:     <serial type="pty">
Aug 16 06:44:33 user nova-compute[74681]:       <log file="/opt/stack/data/nova/instances/50fcfb93-bcaf-4705-b12e-ec04a968ecef/console.log" append="off"/>
Aug 16 06:44:33 user nova-compute[74681]:     </serial>
Aug 16 06:44:33 user nova-compute[74681]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 06:44:33 user nova-compute[74681]:     <video>
Aug 16 06:44:33 user nova-compute[74681]:       <model type="virtio"/>
Aug 16 06:44:33 user nova-compute[74681]:     </video>
Aug 16 06:44:33 user nova-compute[74681]:     <rng model="virtio">
Aug 16 06:44:33 user nova-compute[74681]:       <backend model="random">/dev/urandom</backend>
Aug 16 06:44:33 user nova-compute[74681]:     </rng>
Aug 16 06:44:33 user nova-compute[74681]:     <controller type="usb" index="0" model="none"/>
Aug 16 06:44:33 user nova-compute[74681]:     <memballoon model="virtio">
Aug 16 06:44:33 user nova-compute[74681]:       <stats period="10"/>
Aug 16 06:44:33 user nova-compute[74681]:     </memballoon>
Aug 16 06:44:33 user nova-compute[74681]:   </devices>
Aug 16 06:44:33 user nova-compute[74681]: </domain>
Aug 16 06:44:33 user nova-compute[74681]:  {{(pid=74681) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1650441523',display_name='tempest-TestShelveInstance-server-1650441523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1650441523',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1965226434',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='804b2801c2f645b8979b9c96099b566e',ramdisk_id='',reservation_id='r-mv2m9fnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-902665066',owner_user_name='tempest-TestShelveInstance-902665066-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:44:21Z,user_data=None,user_id='2c2a23b359db41c69a813ead8075c709',uuid=50fcfb93-bcaf-4705-b12e-ec04a968ecef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converting VIF {"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG os_vif [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap908eb268-c7, may_exist=True, interface_attrs={}) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap908eb268-c7, col_values=(('external_ids', {'iface-id': '908eb268-c77b-473d-9f63-10004dd045d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:06:c5', 'vm-uuid': '50fcfb93-bcaf-4705-b12e-ec04a968ecef'}),), if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:33 user nova-compute[74681]: INFO os_vif [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7')
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] No BDM found with device name vda, not building metadata. {{(pid=74681) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 06:44:33 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] No VIF found with MAC fa:16:3e:be:06:c5, not building metadata {{(pid=74681) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 06:44:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:34 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-520e2046-ba22-4534-8fba-9d9dd32f1789 req-c80e6416-7d66-48a5-a4c0-ac3982e8d0bb service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:44:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-520e2046-ba22-4534-8fba-9d9dd32f1789 req-c80e6416-7d66-48a5-a4c0-ac3982e8d0bb service nova] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:44:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-520e2046-ba22-4534-8fba-9d9dd32f1789 req-c80e6416-7d66-48a5-a4c0-ac3982e8d0bb service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:44:35 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-520e2046-ba22-4534-8fba-9d9dd32f1789 req-c80e6416-7d66-48a5-a4c0-ac3982e8d0bb service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:35 user nova-compute[74681]: DEBUG nova.compute.manager [req-520e2046-ba22-4534-8fba-9d9dd32f1789 req-c80e6416-7d66-48a5-a4c0-ac3982e8d0bb service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] No waiting events found dispatching network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:44:35 user nova-compute[74681]: WARNING nova.compute.manager [req-520e2046-ba22-4534-8fba-9d9dd32f1789 req-c80e6416-7d66-48a5-a4c0-ac3982e8d0bb service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received unexpected event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 06:44:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:35 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:36 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692168276.9848776, 50fcfb93-bcaf-4705-b12e-ec04a968ecef => Resumed> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:44:36 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] VM Resumed (Lifecycle Event)
Aug 16 06:44:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance event wait completed in 0 seconds for  {{(pid=74681) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 06:44:36 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Guest created on hypervisor {{(pid=74681) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 06:44:36 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance spawned successfully.
Aug 16 06:44:36 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:44:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 06:44:37 user nova-compute[74681]: DEBUG nova.virt.driver [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] Emitting event <LifecycleEvent: 1692168276.9904203, 50fcfb93-bcaf-4705-b12e-ec04a968ecef => Started> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:44:37 user nova-compute[74681]: INFO nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] VM Started (Lifecycle Event)
Aug 16 06:44:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG nova.compute.manager [None req-0ec40b7f-5b73-4b94-94aa-905685f89cd3 None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=74681) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b95c90c4-e39b-430a-8bfc-6d8d8d453e0c tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.255s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-84ad0753-8a74-4c57-ab31-5cc9fe59d7f5 req-3afdd502-6aa7-4663-af7e-c01190a89d7a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-84ad0753-8a74-4c57-ab31-5cc9fe59d7f5 req-3afdd502-6aa7-4663-af7e-c01190a89d7a service nova] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-84ad0753-8a74-4c57-ab31-5cc9fe59d7f5 req-3afdd502-6aa7-4663-af7e-c01190a89d7a service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-84ad0753-8a74-4c57-ab31-5cc9fe59d7f5 req-3afdd502-6aa7-4663-af7e-c01190a89d7a service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:44:37 user nova-compute[74681]: DEBUG nova.compute.manager [req-84ad0753-8a74-4c57-ab31-5cc9fe59d7f5 req-3afdd502-6aa7-4663-af7e-c01190a89d7a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] No waiting events found dispatching network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:44:37 user nova-compute[74681]: WARNING nova.compute.manager [req-84ad0753-8a74-4c57-ab31-5cc9fe59d7f5 req-3afdd502-6aa7-4663-af7e-c01190a89d7a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received unexpected event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 for instance with vm_state active and task_state None.
Aug 16 06:44:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:44:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:44:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:44:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:44:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:44:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:44:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:45:00 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:45:01 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:45:01 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:45:01 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8457MB free_disk=25.212234497070312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 50fcfb93-bcaf-4705-b12e-ec04a968ecef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:45:01 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:03 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:04 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG nova.objects.instance [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lazy-loading 'info_cache' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [{"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:45:07 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:45:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:09 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:13 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:45:13 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:45:16 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:18 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:23 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Verify base images {{(pid=74681) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74681) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Image id 89d7f25c-29d1-41cf-9690-6814b446c3b9 yields fingerprint 13fc9a78cd830755a2fc6e7257a733567ae84bfe {{(pid=74681) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] image 89d7f25c-29d1-41cf-9690-6814b446c3b9 at (/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe): checking
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] image 89d7f25c-29d1-41cf-9690-6814b446c3b9 at (/opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe): image is in use {{(pid=74681) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] 50fcfb93-bcaf-4705-b12e-ec04a968ecef is a valid instance name {{(pid=74681) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d is a valid instance name {{(pid=74681) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d has a disk file {{(pid=74681) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74681) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d is backed by 13fc9a78cd830755a2fc6e7257a733567ae84bfe {{(pid=74681) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf
Aug 16 06:45:28 user nova-compute[74681]: WARNING nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Unknown base file: /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Active base files: /opt/stack/data/nova/instances/_base/13fc9a78cd830755a2fc6e7257a733567ae84bfe
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Removable base files: /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211 /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439 /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60 /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61 /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8ba7cecd8da43362db30a9838625acf8c6248211
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7e8d059a0cd41c49efad59dbc678b5a63c2a2f7d
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/624c7e55596011a39fcf4bb6ba75c05f175fc1ca
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dc97c7410e961943814bdccd7ce285d418577439
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d9b4a47f0b2f4b2850b9282b33efa0667c81ac60
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6a570034467baa0d217f7af8876238e622bc04cf
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/71b74262b0310192162518329b92d99bb2a24f61
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1fda689a38e5d0576199e5f505e64cac91438bbf
Aug 16 06:45:28 user nova-compute[74681]: INFO nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b5ad889db046948278e0c04d121c248506d16253
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Verification complete {{(pid=74681) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Verify swap images {{(pid=74681) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG nova.virt.libvirt.imagecache [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Verify ephemeral images {{(pid=74681) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 06:45:28 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:45:33 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:45:38 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:43 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:47 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:47 user nova-compute[74681]: INFO nova.compute.manager [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Terminating instance
Aug 16 06:45:47 user nova-compute[74681]: DEBUG nova.compute.manager [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:45:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-fc94d874-b4da-492e-925d-aa1cdc653185 req-8ee165b2-ecd5-4abf-b446-b35a0bfcbf83 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received event network-vif-unplugged-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fc94d874-b4da-492e-925d-aa1cdc653185 req-8ee165b2-ecd5-4abf-b446-b35a0bfcbf83 service nova] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fc94d874-b4da-492e-925d-aa1cdc653185 req-8ee165b2-ecd5-4abf-b446-b35a0bfcbf83 service nova] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-fc94d874-b4da-492e-925d-aa1cdc653185 req-8ee165b2-ecd5-4abf-b446-b35a0bfcbf83 service nova] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-fc94d874-b4da-492e-925d-aa1cdc653185 req-8ee165b2-ecd5-4abf-b446-b35a0bfcbf83 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] No waiting events found dispatching network-vif-unplugged-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.compute.manager [req-fc94d874-b4da-492e-925d-aa1cdc653185 req-8ee165b2-ecd5-4abf-b446-b35a0bfcbf83 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received event network-vif-unplugged-4138d117-4f17-46a5-868b-bf6f2c031f68 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Instance destroyed successfully.
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.objects.instance [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lazy-loading 'resources' on Instance uuid 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T06:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-482528149',display_name='tempest-SnapshotDataIntegrityTests-server-482528149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-482528149',id=51,image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4519zWBhP/u0wLmhoUh7ctSS0WiRmRfFWqPHdk8pKQV8DvWTb2isn008J+YbXShTzFJ1+5LNzhYZ39N+ffSOlkoQnO+WB/ToS/OqtX41NehsnUjVf60PkvOFM6zkAa1Q==',key_name='tempest-keypair-699899462',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:38:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ddf2ada3a5e4457b79cab432befc5e9',ramdisk_id='',reservation_id='r-ibxkk12x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89d7f25c-29d1-41cf-9690-6814b446c3b9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1703853827',owner_user_name='tempest-SnapshotDataIntegrityTests-1703853827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8531a2b8138744d98b13b3cbdcd0c62c',uuid=5dbdce7a-d331-435f-8dd3-d192b8ce7d5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Converting VIF {"id": "4138d117-4f17-46a5-868b-bf6f2c031f68", "address": "fa:16:3e:da:6e:a9", "network": {"id": "7740c34e-0b66-4d60-9956-f4c65cd48b00", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2079144635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddf2ada3a5e4457b79cab432befc5e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4138d117-4f", "ovs_interfaceid": "4138d117-4f17-46a5-868b-bf6f2c031f68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=4138d117-4f17-46a5-868b-bf6f2c031f68,network=Network(7740c34e-0b66-4d60-9956-f4c65cd48b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138d117-4f') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG os_vif [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=4138d117-4f17-46a5-868b-bf6f2c031f68,network=Network(7740c34e-0b66-4d60-9956-f4c65cd48b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138d117-4f') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4138d117-4f, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:45:48 user nova-compute[74681]: INFO os_vif [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:6e:a9,bridge_name='br-int',has_traffic_filtering=True,id=4138d117-4f17-46a5-868b-bf6f2c031f68,network=Network(7740c34e-0b66-4d60-9956-f4c65cd48b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4138d117-4f')
Aug 16 06:45:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Deleting instance files /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d_del
Aug 16 06:45:48 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Deletion of /opt/stack/data/nova/instances/5dbdce7a-d331-435f-8dd3-d192b8ce7d5d_del complete
Aug 16 06:45:48 user nova-compute[74681]: INFO nova.compute.manager [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 06:45:48 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:45:48 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:45:49 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:45:49 user nova-compute[74681]: DEBUG nova.compute.manager [req-d6b00ca3-d29d-4746-8fdb-4f1408f5e1ee req-535472c2-8629-4360-beb1-413e22a882b9 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received event network-vif-deleted-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:45:49 user nova-compute[74681]: INFO nova.compute.manager [req-d6b00ca3-d29d-4746-8fdb-4f1408f5e1ee req-535472c2-8629-4360-beb1-413e22a882b9 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Neutron deleted interface 4138d117-4f17-46a5-868b-bf6f2c031f68; detaching it from the instance and deleting it from the info cache
Aug 16 06:45:49 user nova-compute[74681]: DEBUG nova.network.neutron [req-d6b00ca3-d29d-4746-8fdb-4f1408f5e1ee req-535472c2-8629-4360-beb1-413e22a882b9 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:45:50 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Took 1.32 seconds to deallocate network for instance.
Aug 16 06:45:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-d6b00ca3-d29d-4746-8fdb-4f1408f5e1ee req-535472c2-8629-4360-beb1-413e22a882b9 service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Detach interface failed, port_id=4138d117-4f17-46a5-868b-bf6f2c031f68, reason: Instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d could not be found. {{(pid=74681) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-bbb0c882-60ae-428e-b59d-14ae76091e5a req-6adb6c40-f013-4af0-8fd8-d4b505397d7a service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received event network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bbb0c882-60ae-428e-b59d-14ae76091e5a req-6adb6c40-f013-4af0-8fd8-d4b505397d7a service nova] Acquiring lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bbb0c882-60ae-428e-b59d-14ae76091e5a req-6adb6c40-f013-4af0-8fd8-d4b505397d7a service nova] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-bbb0c882-60ae-428e-b59d-14ae76091e5a req-6adb6c40-f013-4af0-8fd8-d4b505397d7a service nova] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG nova.compute.manager [req-bbb0c882-60ae-428e-b59d-14ae76091e5a req-6adb6c40-f013-4af0-8fd8-d4b505397d7a service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] No waiting events found dispatching network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:45:50 user nova-compute[74681]: WARNING nova.compute.manager [req-bbb0c882-60ae-428e-b59d-14ae76091e5a req-6adb6c40-f013-4af0-8fd8-d4b505397d7a service nova] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Received unexpected event network-vif-plugged-4138d117-4f17-46a5-868b-bf6f2c031f68 for instance with vm_state deleted and task_state None.
Aug 16 06:45:50 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:45:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:50 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Deleted allocations for instance 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d
Aug 16 06:45:50 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-7bdf511d-54cc-4955-93f9-af6dff0440eb tempest-SnapshotDataIntegrityTests-1703853827 tempest-SnapshotDataIntegrityTests-1703853827-project-member] Lock "5dbdce7a-d331-435f-8dd3-d192b8ce7d5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.598s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:45:53 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:45:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:45:58 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74681) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 06:46:02 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:46:02 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.231056213378906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Instance 50fcfb93-bcaf-4705-b12e-ec04a968ecef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74681) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing inventories for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating ProviderTree inventory for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Updating inventory in ProviderTree for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing aggregate associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, aggregates: None {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Refreshing trait associations for resource provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74681) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:46:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:46:03 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692168348.664521, 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:46:03 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] VM Stopped (Lifecycle Event)
Aug 16 06:46:03 user nova-compute[74681]: DEBUG nova.compute.manager [None req-981e58cc-1972-499e-bb90-e068ec0078b7 None None] [instance: 5dbdce7a-d331-435f-8dd3-d192b8ce7d5d] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:46:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:46:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:46:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:46:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:46:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:06 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:08 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:08 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:08 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:46:09 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:46:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:46:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:46:09 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Forcefully refreshing network info cache for instance {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 06:46:09 user nova-compute[74681]: DEBUG nova.network.neutron [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:46:09 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:46:09 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updated the network info_cache for instance {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] There are 1 instances to clean {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] [instance: 70390b89-fdfb-4552-98e5-35568c0268bc] Instance has had 5 of 5 cleanup attempts {{(pid=74681) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11142}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-b641ed8d-e12b-449b-87dc-f25d8bc077af req-40ed9693-12d9-4652-887f-aa0d0cda5f74 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-changed-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG nova.compute.manager [req-b641ed8d-e12b-449b-87dc-f25d8bc077af req-40ed9693-12d9-4652-887f-aa0d0cda5f74 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing instance network info cache due to event network-changed-908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b641ed8d-e12b-449b-87dc-f25d8bc077af req-40ed9693-12d9-4652-887f-aa0d0cda5f74 service nova] Acquiring lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b641ed8d-e12b-449b-87dc-f25d8bc077af req-40ed9693-12d9-4652-887f-aa0d0cda5f74 service nova] Acquired lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG nova.network.neutron [req-b641ed8d-e12b-449b-87dc-f25d8bc077af req-40ed9693-12d9-4652-887f-aa0d0cda5f74 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Refreshing network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:46:11 user nova-compute[74681]: INFO nova.compute.manager [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Terminating instance
Aug 16 06:46:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Start destroying the instance on the hypervisor. {{(pid=74681) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:11 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-8ca1abf5-8b9c-4281-b42b-39e7cae88d37 req-2e5092fc-347f-4241-be88-e89d9a390845 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-unplugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ca1abf5-8b9c-4281-b42b-39e7cae88d37 req-2e5092fc-347f-4241-be88-e89d9a390845 service nova] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ca1abf5-8b9c-4281-b42b-39e7cae88d37 req-2e5092fc-347f-4241-be88-e89d9a390845 service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-8ca1abf5-8b9c-4281-b42b-39e7cae88d37 req-2e5092fc-347f-4241-be88-e89d9a390845 service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-8ca1abf5-8b9c-4281-b42b-39e7cae88d37 req-2e5092fc-347f-4241-be88-e89d9a390845 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] No waiting events found dispatching network-vif-unplugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.compute.manager [req-8ca1abf5-8b9c-4281-b42b-39e7cae88d37 req-2e5092fc-347f-4241-be88-e89d9a390845 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-unplugged-908eb268-c77b-473d-9f63-10004dd045d1 for instance with task_state deleting. {{(pid=74681) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.network.neutron [req-b641ed8d-e12b-449b-87dc-f25d8bc077af req-40ed9693-12d9-4652-887f-aa0d0cda5f74 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updated VIF entry in instance network info cache for port 908eb268-c77b-473d-9f63-10004dd045d1. {{(pid=74681) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.network.neutron [req-b641ed8d-e12b-449b-87dc-f25d8bc077af req-40ed9693-12d9-4652-887f-aa0d0cda5f74 service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [{"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:46:12 user nova-compute[74681]: INFO nova.virt.libvirt.driver [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Instance destroyed successfully.
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.objects.instance [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lazy-loading 'resources' on Instance uuid 50fcfb93-bcaf-4705-b12e-ec04a968ecef {{(pid=74681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-b641ed8d-e12b-449b-87dc-f25d8bc077af req-40ed9693-12d9-4652-887f-aa0d0cda5f74 service nova] Releasing lock "refresh_cache-50fcfb93-bcaf-4705-b12e-ec04a968ecef" {{(pid=74681) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.vif [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T06:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1650441523',display_name='tempest-TestShelveInstance-server-1650441523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1650441523',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS2GPSjsk+n67VfIty9P1LEMeaZk4ywPagHYv14UpkaT/G3b3OfWZe6Yoo91LdO18wTG/PC1Do8cHnrFqZKo0Uhb/6/gpZaqxcGPWnK6oeMEs43QklUkfYgMzXIrUaSNg==',key_name='tempest-TestShelveInstance-1965226434',keypairs=<?>,launch_index=0,launched_at=2023-08-16T06:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='804b2801c2f645b8979b9c96099b566e',ramdisk_id='',reservation_id='r-mv2m9fnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-902665066',owner_user_name='tempest-TestShelveInstance-902665066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T06:44:37Z,user_data=None,user_id='2c2a23b359db41c69a813ead8075c709',uuid=50fcfb93-bcaf-4705-b12e-ec04a968ecef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converting VIF {"id": "908eb268-c77b-473d-9f63-10004dd045d1", "address": "fa:16:3e:be:06:c5", "network": {"id": "a6e85d9e-63df-4098-8867-7d7c39b15d91", "bridge": "br-int", "label": "tempest-TestShelveInstance-231941994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "804b2801c2f645b8979b9c96099b566e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap908eb268-c7", "ovs_interfaceid": "908eb268-c77b-473d-9f63-10004dd045d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.network.os_vif_util [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG os_vif [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7') {{(pid=74681) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap908eb268-c7, bridge=br-int, if_exists=True) {{(pid=74681) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:46:12 user nova-compute[74681]: INFO os_vif [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:06:c5,bridge_name='br-int',has_traffic_filtering=True,id=908eb268-c77b-473d-9f63-10004dd045d1,network=Network(a6e85d9e-63df-4098-8867-7d7c39b15d91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap908eb268-c7')
Aug 16 06:46:12 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] calling os-brick to detach iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f94847535e0>, {'target_iqns': ['iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VRKlYnMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 06:46:12 user nova-compute[74681]: WARNING os_brick.initiator.connectors.base [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 06:46:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe', 0)] {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe30f1a2-a008-43ca-b0d4-94c5c211d29d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:12 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3326a4-7adb-466c-ad5f-dd3722c73c1f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:46:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe (non-flash)
Aug 16 06:46:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f94606d2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe'): ({'sdb'}, set())}) {{(pid=74681) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Removing single pathed devices sdb {{(pid=74681) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b59be8-df9c-4af8-9e5d-4c1ae03a1bff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9eef98-e7ed-4d19-acc5-43d047bb8309]: (4, ('ok\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Flushing IO for device /dev/sdb {{(pid=74681) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec25266-3b00-45b0-8da5-497644a1bb30]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74681) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[13948e95-07c0-463b-ba4b-08fc64db6365]: (4, ('1', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.linuxscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] SCSI volumes sdb have been removed. {{(pid=74681) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe')] {{(pid=74681) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ddb899-74c8-4032-8a9e-8305cd5e8150]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --logout {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[1445c731-003f-4f42-83b1-c0481f1db426]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260]
Aug 16 06:46:13 user nova-compute[74681]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe, portal: 172.16.0.220,3260] successful.
Aug 16 06:46:13 user nova-compute[74681]:  stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op delete {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0969aad-24ec-42f0-b93a-6d7fa1a252fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=121298) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.privsep.daemon [-] privsep: reply[571abffc-0298-4f2e-ba3c-8bb8ff393405]: (4, ('', '')) {{(pid=121298) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74681) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.base [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.635s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] <== disconnect_volume: return (637ms) None {{(pid=74681) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Disconnected iSCSI Volume {{(pid=74681) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 06:46:13 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Deleting instance files /opt/stack/data/nova/instances/50fcfb93-bcaf-4705-b12e-ec04a968ecef_del
Aug 16 06:46:13 user nova-compute[74681]: INFO nova.virt.libvirt.driver [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Deletion of /opt/stack/data/nova/instances/50fcfb93-bcaf-4705-b12e-ec04a968ecef_del complete
Aug 16 06:46:13 user nova-compute[74681]: INFO nova.compute.manager [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Took 1.67 seconds to destroy the instance on the hypervisor.
Aug 16 06:46:13 user nova-compute[74681]: DEBUG oslo.service.loopingcall [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74681) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG nova.compute.manager [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Deallocating network for instance {{(pid=74681) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] deallocate_for_instance() {{(pid=74681) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 06:46:13 user nova-compute[74681]: DEBUG nova.network.neutron [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Updating instance_info_cache with network_info: [] {{(pid=74681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 06:46:13 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Took 0.49 seconds to deallocate network for instance.
Aug 16 06:46:13 user nova-compute[74681]: DEBUG nova.compute.manager [req-23bf90af-64a4-4fab-875c-8e748fb70bca req-a008df44-61e5-44ff-94e3-dc12d53e5acd service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-deleted-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-ae474788-1f98-42e6-a7c1-60a1c875f796 req-b5a3879f-a311-4dd6-bd50-f33cf50ed54a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ae474788-1f98-42e6-a7c1-60a1c875f796 req-b5a3879f-a311-4dd6-bd50-f33cf50ed54a service nova] Acquiring lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ae474788-1f98-42e6-a7c1-60a1c875f796 req-b5a3879f-a311-4dd6-bd50-f33cf50ed54a service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [req-ae474788-1f98-42e6-a7c1-60a1c875f796 req-b5a3879f-a311-4dd6-bd50-f33cf50ed54a service nova] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG nova.compute.manager [req-ae474788-1f98-42e6-a7c1-60a1c875f796 req-b5a3879f-a311-4dd6-bd50-f33cf50ed54a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] No waiting events found dispatching network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 {{(pid=74681) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 06:46:14 user nova-compute[74681]: WARNING nova.compute.manager [req-ae474788-1f98-42e6-a7c1-60a1c875f796 req-b5a3879f-a311-4dd6-bd50-f33cf50ed54a service nova] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Received unexpected event network-vif-plugged-908eb268-c77b-473d-9f63-10004dd045d1 for instance with vm_state active and task_state deleting.
Aug 16 06:46:14 user nova-compute[74681]: INFO nova.compute.manager [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 06:46:14 user nova-compute[74681]: DEBUG nova.compute.manager [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Deleting volume: a0969aad-24ec-42f0-b93a-6d7fa1a252fe {{(pid=74681) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:46:14 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:46:14 user nova-compute[74681]: INFO nova.scheduler.client.report [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Deleted allocations for instance 50fcfb93-bcaf-4705-b12e-ec04a968ecef
Aug 16 06:46:15 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-b0178928-113a-4d1e-86c6-bc9a2bba102f tempest-TestShelveInstance-902665066 tempest-TestShelveInstance-902665066-project-member] Lock "50fcfb93-bcaf-4705-b12e-ec04a968ecef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.319s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:46:16 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:46:27 user nova-compute[74681]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692168372.688516, 50fcfb93-bcaf-4705-b12e-ec04a968ecef => Stopped> {{(pid=74681) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 06:46:27 user nova-compute[74681]: INFO nova.compute.manager [-] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] VM Stopped (Lifecycle Event)
Aug 16 06:46:27 user nova-compute[74681]: DEBUG nova.compute.manager [None req-2e31c44d-fdcd-42ad-85ab-535581def54f None None] [instance: 50fcfb93-bcaf-4705-b12e-ec04a968ecef] Checking state {{(pid=74681) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 06:46:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:46:31 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:31 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74681) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 06:46:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:46:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:46:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:46:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:46:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:46:37 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:41 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:42 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:45 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:47 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:46:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:46:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:46:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:46:52 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:46:56 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:46:57 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Auditing locally available compute resources for user (node: user) {{(pid=74681) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 06:47:02 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:47:02 user nova-compute[74681]: WARNING nova.virt.libvirt.driver [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 06:47:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=25.229400634765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74681) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74681) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG nova.compute.provider_tree [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed in ProviderTree for provider: 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c {{(pid=74681) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG nova.scheduler.client.report [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Inventory has not changed for provider 9b4c6f2b-c2e3-45f1-ae99-adde4eecb43c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74681) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG nova.compute.resource_tracker [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Compute_service record updated for user:user {{(pid=74681) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG oslo_concurrency.lockutils [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74681) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:02 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:03 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:04 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:05 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:07 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:08 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:08 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:09 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:11 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Starting heal instance info cache {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 06:47:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Rebuilding the list of instances to heal {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 06:47:11 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Didn't find any instances for network info cache update. {{(pid=74681) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 06:47:12 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:12 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:13 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:13 user nova-compute[74681]: DEBUG nova.compute.manager [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74681) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 06:47:17 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:18 user nova-compute[74681]: DEBUG oslo_service.periodic_task [None req-cd529a86-6bb8-44d5-806d-e4a41df4457c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74681) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 06:47:22 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:47:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:47:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 06:47:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74681) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 06:47:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:47:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74681) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 06:47:27 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 06:47:32 user nova-compute[74681]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74681) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}